Skip to content

3Blue1Brown personal blog

Visualizing Attention, a Transformer's Heart [video]

by Lesson by Grant Sanderson 3blue1brown.com published 2024-04-07

Demystifying attention, the key mechanism inside transformers and LLMs.

Read on 3blue1brown.com → Discuss on HN (172) Archived copy

Points: 999
HN comments: 172
Submissions: 1
Cited by: 0 commenters

AI & Machine Learning Math & Algorithms 2024

On Hacker News

Submitted	Title on HN	Points	Comments
Apr 14, 2024	Visualizing Attention, a Transformer's Heart [video] by rohitpaulk	999	172

More from 3Blue1Brown

All 4 posts →

Why do prime numbers make these spirals? (2019)

2023372 points100 comments Math & Algorithms details

3Blue1Brown Calculus Blog Series

2023319 points51 comments Math & Algorithms details

SoME1 results

2021286 points32 comments Math & Algorithms details

Related posts from the same era

Bing: “I will not harm you unless you harm me first”

Simon Willison20233,363 points1,673 commentscited by 6 details

GPT-4o

OpenAI Blog20243,138 points2,366 commentscited by 16 details

Open source AI is the path forward

Meta Newsroom20242,360 points887 commentscited by 5 details

My AI skeptic friends are all nuts

Fly.io Blog20252,356 points2,826 commentscited by 13 details

Claude 3.7 Sonnet and Claude Code

Anthropic20252,127 points963 commentscited by 6 details

Claude 4

Anthropic20252,013 points1,170 comments details