Docker Model Runner Now Supports Vulkan GPUs

Docker Model Runner Now Supports Vulkan GPUs

IBM Granite 4.0 Models Now Available on Docker Hub In an exciting development for the tech community, IBM has made its newest version of the Granite 4.0 language models accessible via Docker Hub. This move signifies a significant leap forward in providing developers with easy access to cutting-edge technology that can be integrated into various […]

Docker Model Runner Adds Vulkan GPU Support

Running large language models (LLMs) on your local machine is one of the most exciting frontiers in AI development. At Docker, our goal is to make this process as simple and accessible as possible. That’s why we built Docker Model Runner, a tool to help you download and run LLMs with a single command. Until now, GPU-accelerated inferencing with Model Runner was limited to CPU, NVIDIA GPUs (via CUDA), and Apple Silicon (via Metal). Today, we’re t…