Open-source infrastructure

llm-d

A community-built distributed inference stack for serving open models across clouds, accelerators and model-serving engines.

Timeline & sources Website

At a glance

Origins: 2025 · public project launch
Category: Open-source infrastructure · distributed inference

Support

Open-source project

Project sponsorship and contributor counts are not company financing or employee counts.

View project details & sources

Origins & connections

A CNCF Sandbox project initiated by collaborators from Red Hat, IBM, Google Cloud, CoreWeave and NVIDIA. Founding teams describe institutional project contributors, not individual corporate founders.

On the timeline

2026-10-20llm-d 1.0 brings open inference to production operations

Sources 3

Official project
Original community announcement
1.0 release