Top posts

Every blog post that took off on Hacker News, ranked by the votes of its best submission. 6,334 posts.

AI & Machine Learning
Any year
3859

Fixing Tool-Call Accuracy in vLLM

Tool call accuracy is an important part of serving open-weight AI models. When your tool calls aren’t accurate, the model builds up on nonsensical context. We’ve been carrying our own fork of vLLM to hit 100% in tool call schema accuracy with Kimi and DeepSeek. Fortunately, vLLM 0.31 added support for constrained…

3864

New chips for machine intelligence

This note summarises details of some of the new silicon chips for machine intelligence. Its aim is to distil the most important implementation and architectural details (at least those that are currently available), to highlight the main differences between them. I’m focusing on chips designed for training since they…