Giles Thomas personal blog
LLM from scratch, part 28 – training a base model from scratch on an RTX 3090
I felt like it should be possible to train a GPT-2 small level model on my own hardware using modern tools and open datasets from scratch. It was!
- Points
- 540
- HN comments
- 121
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningSoftware Engineering2025
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Dec 2, 2025 | LLM from scratch, part 28 – training a base model from scratch on an RTX 3090 by gpjt | 540 | 121 |
