⛰️ lucalp personal blog
The bitter lesson is coming for tokenization
Highlights the desire to replace tokenization with a general method that better leverages compute and data. We'll see tokenization's fragility and review the Byte Latent Transformer arch.
- Points
- 303
- HN comments
- 160
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningTech Industry & Business2025
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Jun 24, 2025 | The bitter lesson is coming for tokenization by todsacerdoti | 303 | 160 |
