ARC-AGI without pretraining
We solve 20% of ARC-AGI-1 with no pretraining by minimizing the description length during inference time, with the only data involved being the target puzzle itself.
We solve 20% of ARC-AGI-1 with no pretraining by minimizing the description length during inference time, with the only data involved being the target puzzle itself.
A pause to take stock: realising that attention heads are simpler than I thought explained why we do the calculations we do.
OpenAI recently released their open-weights model. Here we'll discuss how that inevitably leaks some information about their model training stack, and, on the way, show that GPT-5 was trained on phrases from adult websites....
Human drivers keep crashing into Waymos that aren't even moving.
I’ve been trying to slowly ease into using LLMs for coding help again lately (after quitting ), but something always feels off -- like we’re not quite on the...
How LLM-powered programming tools amplify developer capabilities rather than replace them
I’ve been reading this week about how humans learn, and effective ways of transferring knowledge. In addition, I’ve also had AI in the back of my mind, and...
A lot of people think LLMs are expensive to operate. That was true a couple of years ago, but these people haven't updated their views after an approximately 1000x reduction in prices over two years.
Also: another paper that seals the deal
AI coding tools boost productivity but may sacrifice the flow state and deep satisfaction developers experience when writing code by hand. What are we losing?
Historically, general approaches always win in AI. Founders in AI application space now repeat the mistakes of AI researchers.
Notes from my colleagues on AI-assisted software delivery
A blog about making culture. Since 1999.
Although it might seem that AI will make it pointless, I still think it's worth blogging.
blog - kade killary
OR: Claude will you go to prom with me?
Released last night, Grok 4 is now available via both API and a paid subscription for end-users. Update: If you ask it about controversial topics it will sometimes search X …
Why is DeepSeek-V3 supposedly fast and cheap to serve at scale, but too slow and expensive to run locally? Why are some AI models slow to respond but fast once…
Don’t let an LLM make decisions or implement business logic: they suck at that.
Plus how American professors are fighting back against the AI onslaught, a backlash over AI models in Vogue, and more.
|| Paper | Code ||
Feeding slop is an act of war
Recalls at major automakers cost hundreds of millions of dollars a year. It’s a huge issue. To mitigate it, our company created an analytics department solely focused on categorizing warranty claims into actionable problems.
Xe Iaso's personal website.
It turns out that LLMs can make CAD models for simple 3D mechanical parts. And, I think they’ll be extremely good at it soon.
A technique for deterministic labeling from stochastic models, with benchmarked Golang implementation.
There are two claims I’d like to make: LLMs can be used effectively1 for listwise document ranking. Some complex problems can (surprisingly) be solved by transforming them into document ranking problems. I’ve primarily explored both of these claims in the context of using patch diffing to locate N-day…
From 2.5 Pro's lighthouse loop to 3 Pro's "Zombie Phoenix" strategy against Red: a full breakdown of why Gemini 3 Pro is a superior long-horizon agent.