llm-d Blog

llm-d.ai

Kubernetes-native, high-performance distributed LLM inference

Popular posts: 1
Total points: 120
HN comments: 15
Rank: #8,845 company

Visit llm-d.ai → RSS feedOn Hacker News May 2025 – May 2025

Infrastructure & DevOps 1 AI & Machine Learning 1

Most points Most discussed Most cited Newest

LLM-D: Kubernetes-Native Distributed Inference

2025120 points15 comments AI & Machine Learning details

Introducing llm-d: Kubernetes-native distributed LLM inference with KV-cache routing, disaggregated serving, and SOTA performance per dollar. Built on vLLM.