1
The bitter lesson is coming for tokenization
Highlights the desire to replace tokenization with a general method that better leverages compute and data. We'll see tokenization's fragility and review the Byte Latent Transformer arch.
machine learning engineer covering interesting machine learning things
Visit lucalp.dev → RSS feedOn Hacker News Jun 2025 – Jun 2025
Highlights the desire to replace tokenization with a general method that better leverages compute and data. We'll see tokenization's fragility and review the Byte Latent Transformer arch.