SiMa.ai Palette 3.0 Promises up to 3.5x Faster on-Device LLMs
4 Articles
4 Articles
On the 18th, Shima AI (SiMa.ai), an American physical artificial intelligence (AI) semiconductor startup, unveiled 'Palette 3.0', the latest version of a software suite designed to run multiple AI models simultaneously on a single AI chip. According to Shima AI, “Palette 3.0” is based on the AI agent-based software environment “Palette Knit,” which was released last June. 'Palette 3.0' is multiple
SiMa.ai Palette 3.0 promises up to 3.5x faster on-device LLMs
SiMa.ai has released Palette 3.0, the next version of the software for its Modalix AI chips. The San Jose start-up says language models on the chip now generate text up to 3.5 times faster. Power draw stays broadly the same. The gain comes from speculative decoding. A small, fast draft model proposes several tokens at […] This story continues at The Next Web
SiMa.ai's Palette 3.0 runs many AI models on one chip and lifts throughput up to 3.5 times
Physical artificial intelligence chip startup SiMa Technologies Inc. today released Palette 3.0, a new version of its Palette software suite intended to allow many AI models to run concurrently on one chip. According to the company, the release, which builds on the Palette Neat agentic development environment launched in June, can raise model throughput by […]
Coverage Details
Bias Distribution
- 50% of the sources lean Left, 50% of the sources lean Right
Factuality
To view factuality data please Upgrade to Premium







