Cerebras launches AI inference tool to challenge Nvidia

Cerebras Launches Fastest AI Inference Solution, Claims 20x Speed Advantage Over NVIDIA

Cerebras Systems today announced its new AI inference solution, Cerebras Inference, which it claims is the fastest in the world. The solution delivers 1,800 tokens per second for the Llama 3.1 8B model and 450 tokens per second for the Llama 3.1 70B model, making it 20 times faster than NVIDIA GPU-based hyperscale clouds.  Introducing Cerebras Inference‣ Llama3.1-70B at 450 tokens/s – 20x faster than GPUs‣ 60c per M tokens – a fifth the price o…

Cerebras launches Inference, which runs 20 times faster than Nvidia GPUs

Cerebras, an artificial intelligence startup based in Sunnyvale, Calif., launched Inference today, which it said is the fastest AI inference solution. Read more here.

Cerebras launches AI inference tool to challenge Nvidia

Cerebras Launches the World’s Fastest AI Inference

20X performance and 1/5th the price of GPUs- available today Developers can now leverage the power of wafer-scale compute for AI inference via a simple API Cerebras Systems, the pioneer in high performance AI compute, announced Cerebras Inference, the fastest AI inference solution in the world. Delivering 1,800 tokens per second for Llama 3.1 8B and 450 tokens per second for Llama 3.1 70B, Cerebras Inference is 20 times faster than NVIDIA GPU-b…