US EditionRaspberry Pi 5 gets LLM smarts with AI HAT+ 2
The AI HAT+ 2 offers 40 TOPS INT4 inference performance with 8 GB RAM to locally accelerate large language models and generative AI on the Raspberry Pi 5 platform.
- On launch, Raspberry Pi introduced the AI HAT+ 2 built around the Hailo-10H neural network accelerator to enable on-device inference for LLMs and generative AI.
- At launch, Raspberry Pi said DeepSeek-R10-Distill, Llama3.2 and Qwen2 family models will be available, mostly 1.5-billion-parameter, framing the HAT+ 2 for local inference use.
- The board plugs into the Pi 5 via GPIO connector and PCIe interface; it includes an optional passive heatsink, spacers and screws for active cooler fitting, and requires fresh Raspberry Pi OS with Docker and hailo-ollama, while rpicam-apps supports the hardware natively.
- The AI HAT+ 2 increases on-device inference performance relative to the earlier AI HAT+, but Raspberry Pi acknowledged 8 GB onboard RAM may limit memory-hungry AI workloads and thermal constraints persist.
- By comparison, cloud LLMs start at about 500 billion parameters, and Raspberry Pi said users can specify a Pi 5 with 16 GB RAM amid thermal trade-offs, raising questions about target users.
11 Articles
11 Articles
Raspberry Pi’s new add-on board has 8GB of RAM for running gen AI models
Raspberry Pi is launching a new add-on board capable of running generative AI models locally on the Raspberry Pi 5. Announced on Thursday, the $130 AI HAT+ 2 is an upgraded - and more expensive - version of the module launched last year, now offering 8GB of RAM and a Hailo 10H chip with 40 TOPS of AI performance. Once connected, the Raspberry Pi 5 will use the AI HAT+ 2 to handle AI-related workloads while leaving the main board's Arm CPU availa…
A new additional board (HAT) is equipping an AI accelerator on the Raspberry Pi 5, which can finally also run some generative AI models. This is made possible by the chip Hailo-10H and some main memory. Anyone who wanted to teach Raspbery Pi some artificial intelligence could so far use the AI HAT+. On it either the AI chip Hailo-8 or the Hailo-8L worked.
About a year ago, the Raspberry Pi Foundation released the AI HAT+, an expansion for the Raspberry Pi 5 focused on image recognition using neural networks. Now, they're following up with the AI... Read the article: Raspberry Pi AI HAT+ 2: Generative AI on the Raspberry Pi 5
Coverage Details
Bias Distribution
- 67% of the sources are Center
Factuality
To view factuality data please Upgrade to Premium
