Why do LLMs freak out over the seahorse emoji?
Investigating the seahorse emoji doom loop using logitlens.
Blog about linguistics, programming, and my projects
Visit vgel.me → On Hacker News Oct 2015 – Oct 2025
Software Engineering 6AI & Machine Learning 5Tools & Productivity 1Society, Policy & Culture 1Security & Privacy 1Math & Algorithms 1
Investigating the seahorse emoji doom loop using logitlens.
Blog about linguistics, programming, and my projects
To better understand how transformers work, I hand-assigned all the weights to predict a simple sequence.
Playing around with the Representation Engineering paper, I made some interesting control vectors, and a Python package to make your own.
A walkthrough of 46 lines of code that render a 3D ASCII donut using signed distance functions.
Blog about linguistics, programming, and my projects
Augmenting GPT-3 with tools is a popular technique right now. But is GPT-3 really using them?