Top posts

Every blog post that took off on Hacker News, ranked by the votes of its best submission. 1,523 posts.

AI & Machine Learning
2026
1484

Making a vintage LLM from scratch

In this blog post, I will share the adventures I had creating my own LLM, from (almost) scratch, trained only on old texts. I made my own base-training and fine-tuning scripts, data processing pipelines and custom datasets. ("almost from scratch" means I did use existing programming languages and libraries, I didn't…