Apple shows how much faster the M5 runs local LLMs on MLX

Apple shows how much faster the M5 runs local LLMs on MLX

A new post on Apple’s Machine Learning Research blog shows how much the M5 improved over the M4 when it comes to running a local LLM.

Apple claims M5 runs AI models nearly 30% faster than M4

Apple is positioning the new M5-powered MacBook Pro as a far more capable machine for running and experimenting with large language models, thanks to upgrades to both its MLX framework and the GPU Neural Accelerators built into the chip. For researchers and developers who increasingly prefer to work directly on Apple silicon hardware, the company is pitching the M5 line as a meaningful step forward in on-device inference performance, especially …

M5 Chip Shows Major Speed Gains in Local LLM Performance Over the M4

Apple has shared new performance tests showing how the M5 chip dramatically improves local large language model processing compared with last year’s M4. According to 9to5Mac’s reporting, Apple ran a series of controlled benchmarks that measured how both chips handled on-device LLM workloads, highlighting how much faster the new architecture can compile, load and process models without relying on cloud servers. The comparison used the same models…

Apple shows how much faster the M5 runs local LLMs compared to the M4

A new post on Apple's Machine Learning Research blog shows how much the M5 Apple silicon improved over the M4 when it comes to running a local LLM. Here are the details. more . . .