Software Engineer Runs Generative AI On 20-Year-Old PowerBook G4

A Powerbook G4 can run an LLM -- but not fast enough to be practical

A software developer has proven it is possible to run a modern LLM on old hardware like a 2005 PowerBook G4, albeit nowhere near the speeds expected by consumers.

Software Engineer Runs Generative AI on 20-Year-Old PowerBook G4

In a blog post this week, software engineer Andrew Rossignol (my brother!) detailed how he managed to run generative AI on an old PowerBook G4. While...

Getting a modern LLM running on a 2005 PowerBook G4 Mac

The Resistor Network blog takes on the challenge of running a Large Language Model (LLM, re. an “AI”) on vintage hardware – in this case a 2005 PowerBook G4 Mac. There is something incredibly satisfying about breathing new life into old hardware. Vintage computing is one of my favorite hobbies. The challenge of coaxing modern software onto systems designed decades ago is a puzzle I cannot resist. I have been diving into the world of large langua…

Software Engineer Runs Generative AI On 20-Year-Old PowerBook G4

A software engineer successfully ran Meta's Llama 2 generative AI model on a 20-year-old PowerBook G4, demonstrating how well-optimized code can push the limits of legacy hardware. MacRumors' Joe Rossignol reports: While hardware requirements for large language models (LLMs) are typically high, thi...