Baidu Releases ERNIE 5.5 Flash Base with 280 Billion Parameters as an Open-Source Foundation Model
This story is only covered by news sources that have yet to be evaluated by the independent media monitoring agencies we use to assess the quality and reliability of news outlets on our platform. Learn more here.8 Articles
8 Articles
Baidu, a major Chinese technology company, has released its AI model "ERNIE 5.5 Flash Base" as an open model. Read more...
Baidu Open-Sources ERNIE-5.5-Flash-Base, a 280B MoE Base Model With 14B Active Parameters
Baidu has released ERNIE-5.5-Flash-Base, the raw pretraining checkpoint of its ERNIE 5.5 Flash model, on Hugging Face, the ERNIE team said on November 5. The sparse mixture-of-experts (MoE) language model has 280 billion total parameters and activates 14 billion per token. It was trained from scratch on 33.5 trillion tokens with a maximum training context of 128K tokens, while fine-tuning and inference support contexts of up to 1 million tokens.…
Baidu releases ERNIE 5.5 Flash Base with 280 billion parameters as an open-source foundation model
Baidu releases ERNIE 5.5 Flash Base: a 280-billion-parameter MoE model pre-trained on 33.5 trillion tokens, shipped deliberately without fine-tuning, so developers can take it wherever they want. The article Baidu releases ERNIE 5.5 Flash Base with 280 billion parameters as an open-source foundation model appeared first on The Decoder.
Baidu releases ERNIE 5.5 Flash Base, a blend of experts language model with 280 billion parameters, of which only 14 billion are active per token. The model pre-trained on 33.5 trillion tokens is released without fine tuning – as a starting point for community adjustments. The article Baidu publishes ERNIE 5.5 Flash Base with 280 billion parameters as an open source base model first appeared on The Decoder.
Coverage Details
Bias Distribution
- There is no tracked Bias information for the sources covering this story.
Factuality
To view factuality data please Upgrade to Premium
