Can a Chip That Loves Zeros Make Huge AI Models More Efficient?

Can a Chip That Loves Zeros Make Huge AI Models More Efficient?

When it comes to AI models, size matters.Even though some artificial-intelligence experts warn that scaling up large language models (LLMs) is hitting diminishing performance returns, companies are still coming out with ever larger AI tools. Meta’s latest Llama release had a staggering 2 trillion parameters that define the model.As models grow in size, their capabilities increase. But so do the energy demands and the time it takes to run the mod…