1
BERT is just a single text diffusion step
A while back, Google DeepMind unveiled Gemini Diffusion, an experimental language model that generates text using diffusion. Unlike traditional GPT-style models …
nathan.rs
This is the website of Nathan Barry
- Popular posts
- 3
- Total points
- 1,026
- HN comments
- 316
- Rank
- #2,089 personal
Visit nathan.rs → RSS feedOn Hacker News May 2025 – Sep 2026
2
Can gzip be a language model?
A while back I wrote about language modeling without neural networks, where I generated Shakespeare with an unbounded n-gram model: no weights, no training, …
3
Running GPT-2 in WebGL: Rediscovering the Lost Art of GPU Shader Programming
A few weeks back, I implemented GPT-2 using WebGL and shaders (Github Repo) which made the front page of Hacker News. Here is a short write-up over what I …