llm-d Blog company blog
LLM-D: Kubernetes-Native Distributed Inference
Introducing llm-d: Kubernetes-native distributed LLM inference with KV-cache routing, disaggregated serving, and SOTA performance per dollar. Built on vLLM.
- Points
- 120
- HN comments
- 15
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningInfrastructure & DevOps2025
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| May 20, 2025 | LLM-D: Kubernetes-Native Distributed Inference by smarterclayton | 120 | 15 |
