Skip to content

Transformer Circuits company blog

Toy Models of Superposition

transformer-circuits.pub

Read on transformer-circuits.pub → Archived copy

Points: 0
HN comments: 0
Submissions: 0
Cited by: 17 commenters

AI & Machine Learning Software Engineering 2022

Cited in comments

Linked from 18 Hacker News comments by 17 different people, from Oct 2022 to Dec 2025.

Most recent:

jiggawatts · Dec 29, 2025
m_ke · Nov 22, 2025
sdenton4 · Sep 15, 2025
l1n · Sep 15, 2025
dwohnitmok · Sep 15, 2025
colah3 · May 20, 2025

Search every comment that links here →

More from Transformer Circuits

All 5 posts →

Circuit Tracing: Revealing Computational Graphs in Language Models (Anthropic)

2025173 points27 commentscited by 12AI & Machine Learning details

Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet

2024168 points124 commentscited by 21AI & Machine Learning details

The Biology of a Large Language Model

2025117 points19 commentscited by 30AI & Machine Learning details

A Mathematical Framework for Transformer Circuits (2021)

2026107 points17 commentscited by 13AI & Machine Learning details

Related posts from the same era

Bing: “I will not harm you unless you harm me first”

Simon Willison20233,363 points1,673 commentscited by 6 details

Building a Virtual Machine Inside ChatGPT

Jonas Degrave20222,029 points908 commentscited by 16 details

ChatGPT Plugins

OpenAI Blog20231,875 points1,106 commentscited by 14 details

Whisper – open source speech recognition by OpenAI

OpenAI Blog20221,705 points481 commentscited by 5 details

Twitter's Recommendation Algorithm

Twitter Blog20231,700 points1,187 comments details

A GPT in 60 Lines of NumPy

Jay Mody20231,563 points146 commentscited by 10 details