Giles Thomas personal blog
Writing an LLM from scratch, part 8 – trainable self-attention
Moving on from a toy self-attention mechanism, it's time to find out how to build a real trainable one. Following Sebastian Raschka's book 'Build a Large Language Model (from Scratch)'. Part 8/??
- Points
- 380
- HN comments
- 31
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningSoftware Engineering2025
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Mar 5, 2025 | Writing an LLM from scratch, part 8 – trainable self-attention by gpjt | 380 | 31 |
