Mike Veerman personal blog
How fast is N tokens per second really?
Every local-LLM benchmark reports throughput: "47 tok/s on an M3," "180 tok/s on a 4090," "500 tok/s on Groq." Unless you've actually watched tokens stream at those rates, the numbers are hard to internalize. This is the rendering.
- Points
- 494
- HN comments
- 96
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningSystems & Performance2026
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| May 18, 2026 | How fast is N tokens per second really? by hexagr | 494 | 96 |
