What can LLMs never do?
On goal drift and lower reliability. Or, why can't LLMs play Conway's Game Of Life?
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 3,090 posts.
On goal drift and lower reliability. Or, why can't LLMs play Conway's Game Of Life?
[Twitter thread, Hacker News discussion]
This isn't innovation, it's tyranny
Table of Contents Intro Contest in short Problem intro Why this problem is auto-research-able Learning Enough to Ask Better Questions (Optional) Math f...
Some thoughts on Astra and newfangled long-horizon models.
The shameless spin around Stargate UAE
I have been interested in machine-assisted ways to do and teach mathematics from as far back as 1999, when I started coding several applets in Java 1.0, both for my complex analysis and linear alge…
A while back, Google DeepMind unveiled Gemini Diffusion, an experimental language model that generates text using diffusion. Unlike traditional GPT-style models …
Back in my day, we used math for autocomplete.
I’ve been playing around with OpenAI’s new GPT-3 language model. When I got beta access, the first thing I wondered was, how human is GPT-3? How close is it ...
A humorous exploration of the uncanny resemblance between AI company logos and human anatomy. Discover why circular, gradient-based designs dominate the AI industry, and what this design convergence tells us about branding in tech.
One of my favourite features of ChatGPT is its ability to write and execute code in a container. This feature launched as ChatGPT Code Interpreter nearly three years ago, was …
In Which I Try to Maintain Human Supremacy for a Bit Longer
A deep dive into Claude Code for daily users. Covers the .claude directory, CLAUDE.md the way Boris writes it, CLAUDE.local.md, Skills with real examples, custom subagents, plugins, underused commands like /goal and /insights, MCPs, and the workflow patterns the Anthropic team actually uses.
I've been working with TPUs a lot recently and it's fun to see how they had such different design philosophies compared to GPUs.
“These models somehow just generalize dramatically worse than people. It's a very fundamental thing.”
Musings of a Computer Scientist.
After 40 years, 30 million rules, 200 million dollars, 2000 person-years, and many promises, Cyc has failed to reach intellectual maturity, and may never will. Exacerbated by the secrecy and insularity of Cycorp, there remains no evidence of its general intelligence.
A breakdown of Claude's memory implementation, how it differs from ChatGPT, and what these opposite approaches reveal about each company's philosophy.
The definitive guide to Random Forests and Decision Trees.
This isn’t a rant against AI. I use it daily, ChatGPT, Copilot, Claude, Gemini. They’re in my workflow like everyone else’s. But the tradecraft is slipping. Analysts are skipping the hard parts. They’re trusting GenAI to do the heavy cognitive lifting, and it’s changing how we operate at a foundational level.
What images were used to train Stable Diffusion's text-to-image AI model? I worked with Simon Willison to make a data browser to explore and search a sample of 12 million images.
A metascience post of sorts that argues we should take human capital more seriously
When Language Models Learn to See and Create
This legendary page from an internal IBM training in 1979 could not be more appropriate for our new age of AI. A computer can never be held accountable Therefore a …
Agents can write code faster than we can absorb it. Here's why it still matters for humans to understand what they build — and some techniques for doing that efficiently: explainer docs, quizzes, micro-worlds, and shared spaces.
I am an AI hater. This is considered rude, but I do not care, because I am a hater.