Baseten Blog company blog
The efficient frontier of LLM inference
Inference techniques either move a deployment along the latency–throughput frontier or push the entire frontier out, creating more efficiency to allocate.
- Points
- 155
- HN comments
- 46
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningInfrastructure & DevOps2026
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Sep 1, 2026 | The efficient frontier of LLM inference by philipkiely | 155 | 46 |