Revenge of the GPT Wrappers: Defensibility in a world of commoditized AI models
Why network effects and distribution will be king, once more
Why network effects and distribution will be king, once more
We explore language models that recursively call themselves or other LLMs before providing a final answer. The aim is essentially unbounded context, and a way through context rot.
Gradient descent is the preferred way to optimize neural networks and many other machine learning algorithms but is often used as a black box. This post explores how many of the most popular gradient-based optimization algorithms such as Momentum, Adagrad, and Adam actually work.
Here’s a Mastodon thread from a year ago. Just a quick check on how ChatGPT’s getting on … Me: Who reassigned the species Brachiosaurus brancai to its own genus, and when? ChatGPT…
I define "intelligence" as being capable of knowing or understanding, at least within some domain. ChatGPT cannot know or understand anything, so it is not intelligence. It does not know what its output means. It has no idea that words can mean anything.
Using LLMs doesn't make a product special anymore
Current reasoning models trained with Reinforcement Learning with Verifiable Rewards (RLVR) often rely on manually curated datasets, raising scalability concerns and potentially limiting future AI growth beyond human-defined tasks. To address this, we propose the Absolute Zero paradigm, where a single model…
Congratulations to the xAI team—and the advocates of the scaling laws
The Unreliability of LLMs & What Lies Ahead
Robots won't replace me, but another human probably will.
The best Stratechery content from the week of October 6, 2025, including OpenAI’s Windows strategy, Sam Altman and boundless ambition, and the future of creation.
The very first LLM-based product, ChatGPT, was just the ability to talk with the model itself: in other words, a pure chatbot. This is still the most popular…
My personal website
Psychologically Plausible Deep Learning with Differentiable Tversky Similarity
When you paste ChatGPT’s response instead of your own feedback, you’re not being helpful. You’re being lazy and creating more work for everyone.
Then what happens if AI is doing the writing and reading?
Personal blog of Stephen Diehl - Software engineer writing about technology, programming, and the future
Everyone’s been talking about it. JD Vance read it. What does it actually tell us?
WTF moment: Why my native OS refuses to return a "True" value.
HN Discussion
Like this newsletter? Why not listen to the podcast version on Better Offline? Part 1 is out now (here're other links), and Part 2 comes out Friday May 2nd! I'm sick and god-damn tired of this! I have written tens of thousands of words about this and
When I wrote about how good ChatGPT with GPT-5 is at search yesterday I nearly added a note about how comparatively disappointing Google's efforts around this are. I'm glad I …
First slowly, and then all at once, dreams of LLMs bringing us to the cusp of AGI have fallen apart.
I get it, you’re too good to vibe code. You’re a senior developer who has been doing this for 20 years and knows the system like the back of your hand. Or maybe you’re the star individual contributor who is the only person who can ever figure out how to solve the hard problems. Or maybe you’re the professor who…
Notes from my colleagues on AI-assisted software delivery
This post is about an important, but also scary, prompt injection discovery that leads to full system compromise of the developer’s machine in GitHub …
The machine learning community is finally waking up to the madness, but the detour of the last few years has been costly.