Top posts

Every blog post that took off on Hacker News, ranked by the votes of its best submission. 6,299 posts.

Any topic
2023
2096

The Transformer Family

Many new Transformer architecture improvements have been proposed since my last post on “The Transformer Family” about three years ago. Here I did a big refactoring and enrichment of that 2020 post — restructure the hierarchy of sections and improve many sections with more recent papers. Version 2.0 is a superset of…