Cosma Shalizi personal blog

"Attention", "Transformers", in Neural Network "Large Language Models"

I find this literature irritating and opaque. This is at least somewhat because I do not yet understand it well, and there's too much of it. But clearly I need to wrap my head around it, before I become technically obsolete. My scare quotes in the title of these notes thus derive in part from jealousy and fear. But…
Points
300
HN comments
76
Submissions
1
Cited by
17 commenters

AI & Machine Learning2023

On Hacker News

SubmittedTitle on HNPointsComments
Dec 24, 2023"Attention", "Transformers", in Neural Network "Large Language Models" by macleginn30076

Cited in comments

Linked from 19 Hacker News comments by 17 different people, from May 2023 to Jul 2026.

Most recent:

Search every comment that links here →

More from Cosma Shalizi

All 4 posts →

Related posts from the same era