DeepSeek Open-Sources the Inference Engine Behind Its API. And Huawei Gets Equal Billing with Nvidia.

DeepSeek open-sources the inference engine behind its API. And Huawei gets equal billing with Nvidia.

DeepInfer lets developers self-host V4.1 Flash with DeepSeek’s own optimizations, but stops short of a complete production stack.

“Sharing our production stack”: DeepSeek open-sources DeepInfer

DeepSeek has open-sourced DeepInfer, the software it uses to run its AI models in production. The Chinese AI lab announced the release on X on Tuesday and published the code on GitHub under the Apache 2.0 licence. For now, it supports only DeepSeek-V4.1-Flash. 🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering […] This story continues at The Next Web

DeepSeek open-sources DeepInfer software for running its AI models

The DeepInfer framework supports the V4.1-Flash model on NVIDIA and Huawei chips and omits several parts of a full service

DeepSeek Unveils Open-Source Tool to Help Cut AI Operating Costs

DeepSeek is opening up the software it uses to run its artificial intelligence models at scale, potentially making its technology cheaper and easier for businesses to run.

DeepSeek Fully Opens DeepInfer Framework Used for V4.1 Flash

The company says DeepInfer already supports large-scale V4.1 Flash inference and will host code and optimizations for future models.

DeepSeek Open-Sources DeepInfer, the Inference Framework Behind DeepSeek-V4.1-Flash

DeepSeek has open-sourced DeepInfer, the Apache 2.0 inference framework that serves DeepSeek-V4.1-Flash in production. It targets NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs, and ships offline inference only.