What Do LLMs Want from Hardware

What Do LLMs Want from Hardware

Figure 1: Noam Shazeer, Google Gemini vice president, presented this in his Hot Chips 2025 talk. Noam Shazeer is Google’s vice president of engineering for Gemini, their LLM competitor to ChatGPT. He talked recently at Hot Chips: “Predictions for the Next Phase of AI.” He has worked on LLMs for a decade since inventing the transformer model in 2017. As his slide says, LLMs can take advantage of more of everything from hardware to improve perform…