Neomind Labs Blog company blog
Running Gemma 4 26B at 5 tokens/sec on a 13-year-old Xeon with no GPU
A storage appliance that shipped before AVX2 existed now runs Google's Gemma 4 26B in my basement, no GPU. Here's how we got a modern MoE model onto a CPU older than the instructions its inference engine assumed were there.
- Points
- 329
- HN comments
- 212
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningSystems & Performance2026
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Jul 15, 2026 | Running Gemma 4 26B at 5 tokens/sec on a 13-year-old Xeon with no GPU by neomindryan | 329 | 212 |
