US EditionPublished • loading... • Updated
Prismml Bonsai: the First Viable 1-Bit Llm Runs 8 Billion Parameters on an Iphone
Summary by Coin Academy
This story is only covered by news sources that have yet to be evaluated by the independent media monitoring agencies we use to assess the quality and reliability of news outlets on our platform. Learn more here.1 Articles
1 Articles
What to remember: PrismML comes out of the shadow with Bonsai 8B, a one-bit language model of 8.2 billion parameters that holds in 1.15 GB of memory, 14 times less than a classic model. The model turns 44 tokens/second on iPhone 17 Pro Max and 131 tokens/second on Mac M4 Pro, while remaining competitive on standard benchmarks. Based on Caltech's research and supported by Khosla Ventures, Google and Cerberus, Bonsai is available in open source un…
Coverage Details
Total News Sources1
Leaning Left0Leaning Right0Center0Last UpdatedBias DistributionNo sources with tracked biases.
Bias Distribution
- There is no tracked Bias information for the sources covering this story.
Factuality
To view factuality data please Upgrade to Premium
