Top posts

Every blog post that took off on Hacker News, ranked by the votes of its best submission. 49,221 posts.

Any topic
Any year
17823

The Q, K, V Matrices

At the core of the attention mechanism in LLMs are three matrices: Query, Key, and Value. These matrices are how transformers actually pay attention to different parts of the input. In this write-up, we will go through the construction of these matrices from the ground up.

17835

Highly Successful Bootstrapped Startups

Photo by earthlightbooks This is a guest article by Saba Younus. Saba currently works as the operations manager (Sumo) at AppSumo . When she’s not working to create the best experience for each and every user, she spends her time scouring the web for juicy details about the startup worl

17847

Life at a startup

As a child, I had read about the Homebrew Computer Club, where Osborne and Apple were born - and I wanted to be part of a big movement like that ever since. When I first heard about Y Combinator I thought here was something happening right now that might be looked back on in the same way. I worked my way through the…