IBM, Red Hat, and Google Just Donated a Kubernetes Blueprint for LLM Inference to the CNCF

IBM, Red Hat, and Google just donated a Kubernetes blueprint for LLM inference to the CNCF

The marriage of Kubernetes and AI has arrived in llm‑d, a replicable Kubernetes blueprint to deploy inference stacks for any model, on any accelerator, in any cloud. On Tuesday at KubeCon Europe 2026 in Amsterdam, IBM Research, Red Hat, and Google Cloud announced the donation of llm‑d, their open‑source distributed inference framework, to the Cloud Native Computing Foundation (CNCF) as a sandbox project. The move, supported by founding collabora…

Red Hat bets big on Kubernetes inference with llm-d

As AI demands drive orders-of-magnitude increases in token consumption, the need for scalable, production-grade Kubernetes inference has never been greater. The challenge now is less about training ever-larger models than about running them reliably, cheaply and at scale. In response, Red Hat Inc. has contributed llm-d, an open-source project for running large language models across […] The post Red Hat sees inference as AI’s next battleground —…

llm-d joins the CNCF

llm-d has been officially accepted as a CNCF Sandbox project. The Kubernetes-native inference framework from Red Hat and partners provides open AI infrastructure.