New

The latest blog posts to take off on Hacker News. 1,421 posts.

Software Engineering
2026
667

Making a vintage LLM from scratch

In this blog post, I will share the adventures I had creating my own LLM, from (almost) scratch, trained only on old texts. I made my own base-training and fine-tuning scripts, data processing pipelines and custom datasets. ("almost from scratch" means I did use existing programming languages and libraries, I didn't…