LLMs will be 100 times more cost-efficient by 2030

LLMs will be 100 times more cost-efficient by 2030

By 2030, performing inference on a large language model (LLM) with one trillion parameters will cost GenAI providers over 90% less than it did in 2025, according to Gartner. AI tokens are the units of data that GenAI models process. For the purposes of this analysis a token is 3.5 bytes of data, or approximately 4 characters. “These cost improvements will be driven by a combination of semiconductor and infrastructure efficiency improvements, mod…