Transformer Circuits

transformer-circuits.pub

Can we reverse engineer transformer language models into human-understandable computer programs?

Popular posts: 5
Total points: 565
HN comments: 187
Rank: #2,432 company

Visit transformer-circuits.pub → RSS feedOn Hacker News Oct 2022 – Sep 2026

AI & Machine Learning 5 Software Engineering 3 Science & Space 1 Math & Algorithms 1

Most points Most discussed Most cited Newest

The Biology of a Large Language Model

2025117 points19 commentscited by 30AI & Machine Learning details

We investigate the internal mechanisms used by Claude 3.5 Haiku — Anthropic's lightweight production model — in a variety of contexts, using our circuit tracing methodology.