Executing programs inside transformers with exponentially faster inference
We build a computer inside a transformer — executing arbitrary C programs for millions of steps with exponentially faster inference via 2D attention heads.
We build a computer inside a transformer — executing arbitrary C programs for millions of steps with exponentially faster inference via 2D attention heads.
Exploring five critical questions shaping software engineering through 2026, with contrasting scenarios for each. These lenses help prepare for the evolving ...
From the Archive: Thoughts on Swift, while learning Rust
Who’s this for Basics How data is stored in disk How indexes speedup access to data Costs associated with indexes Disk Space Write operations Query planner Memory usage Types of Indexes Btree Hash BRIN GIN GiST & SP-GiST Conclusion Who’s this for This text is for developers that have an intuitive knowledge of what…
Bend just serves as a useful example of my general point regarding vibe-coding as it is recent, high-profile, and has aspects that make it easy to use as an example. I don’t know anything about the author’s history with designing languages or if they actually did consider the tradeoffs below and made what I think is a…
The technical musings of Iain Cambridge.
Discover how AlphaEvolve optimizes algorithms for genomics, quantum physics, global infrastructure, and more to accelerate scientific progress and solve real-world challenges.
An overview of DiffusionGemma, an exceptionally fast text generation model with up to 4x faster speeds.
How I reverse-engineered GitHub node IDs to avoid a database migration and discovered their dual ID system along the way.
Claude Code records each session to disk. Those logs include “thinking blocks” — the model’s own reasoning as it works.
Hook fields that rewrite commands mid-flight, persistent agent memory, auto-mode rules in plain English, self-improving dream loops, and every example is copy-paste ready.
The manifestation of my imposter syndrome, for me and today, is what does it mean to be a software engineer. There’s a lot more noise than signal on the Internet about agentic engineering, wh…
I challenged myself to make a tiny subset of Python in C.
From COBOL in the 1960s to AI in the 2020s, every generation promises to eliminate programmers. Explore the recurring cycles of software simplification hype.
The one where I go crawling back.
The Only Programming Language Built on Mathematics, Not Fashion
A few months ago I was tasked with creating an internal tool for the company's engineers: a Chat that used a local LLM. Nothing extraordinary so far…
Learn how I built an ai receptionist for my brother's mechanic shop
I’m sometimes late to notice new and terrible things about macOS 26 Tahoe, because I use it only for testing, on a secondary Mac. My main Mac remains on Sequoia, as enforced by Little Snitch . I was of course aware that app windows on Tahoe have exaggerated corner radiuses, but I was unaware until now that the window…
From the Zed Blog: Agents turned the conversation into the real source of our software. DeltaDB is the version control built for it.
A blog about software craft and quality
Literally no one is uttering what we thought were the immortal lines “learn to code,” right? I don't think that sentence has been spoken for many months now in Silicon Valley
On reward functions, dopamine, and what it actually feels like when the code starts writing itself
Turning "cat readme.txt" into arbitrary code execution in iTerm2.
News post: Gleam v1.19.0 released!
The official home of the Python Programming Language
Fearless SIMD v1.0 is here
We cut PR wait time and running costs by rethinking CI as a system, from the infrastructure underneath it to how work gets scheduled and tests get parallelized.
Someone on Reddit recently asked: What would make a Rust implementation of something faster than a C implementation, all things being the same? I think this is…