New

The latest blog posts to take off on Hacker News. 301 posts.

AI & Machine Learning
2022
186

RETRO is fast

When I first read Google’s RETRO paper, I was skeptical. Sure, RETRO models are 25x smaller than the competition, supposedly leading to HUGE savings in training and inference costs. But what about the new trillion token “retrieval database” they added to the architcture? Surely that must add back some computational…