Best of 2026

The blog posts Hacker News loved most in 2026. 1,520 posts.

AI & Machine Learning
897

The Q, K, V Matrices

At the core of the attention mechanism in LLMs are three matrices: Query, Key, and Value. These matrices are how transformers actually pay attention to different parts of the input. In this write-up, we will go through the construction of these matrices from the ground up.