Recursive Language Models (RLMs)
We explore language models that recursively call themselves or other LLMs before providing a final answer. The aim is essentially unbounded context, and a way through context rot.
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 1,227 posts.
We explore language models that recursively call themselves or other LLMs before providing a final answer. The aim is essentially unbounded context, and a way through context rot.
Gradient descent is the preferred way to optimize neural networks and many other machine learning algorithms but is often used as a black box. This post explores how many of the most popular gradient-based optimization algorithms such as Momentum, Adagrad, and Adam actually work.
Here’s a Mastodon thread from a year ago. Just a quick check on how ChatGPT’s getting on … Me: Who reassigned the species Brachiosaurus brancai to its own genus, and when? ChatGPT…
I define "intelligence" as being capable of knowing or understanding, at least within some domain. ChatGPT cannot know or understand anything, so it is not intelligence. It does not know what its output means. It has no idea that words can mean anything.
Using LLMs doesn't make a product special anymore
Asynchrony, fast approximate exponents, and 10x more efficient softmax.
Understanding how search engines transform text into tokens through character filtering, tokenization, stemming, and stopword removal.
Educators can show in secondary school maths that AI systems don’t think, making maths more interesting while teaching core concepts of AI.
Current reasoning models trained with Reinforcement Learning with Verifiable Rewards (RLVR) often rely on manually curated datasets, raising scalability concerns and potentially limiting future AI growth beyond human-defined tasks. To address this, we propose the Absolute Zero paradigm, where a single model…
Congratulations to the xAI team—and the advocates of the scaling laws
The Unreliability of LLMs & What Lies Ahead
Robots won't replace me, but another human probably will.
We’re expanding the ability to edit your images by simply asking in Google Photos to Android devices.
Read the full Q2 2026 research report, explore the chart data, and download the PDF for free.
Recent generations of frontier language models have introduced Large Reasoning Models (LRMs) that generate detailed thinking processes…
The best Stratechery content from the week of October 6, 2025, including OpenAI’s Windows strategy, Sam Altman and boundless ambition, and the future of creation.
The very first LLM-based product, ChatGPT, was just the ability to talk with the model itself: in other words, a pure chatbot. This is still the most popular…
Check Point's AI Security Solutions deliver AI-driven threat prevention and unified security management for advanced protection across enterprise networks.
My personal website
Introduction to Kumo Relational — the relational foundation model for predictive AI on relational data
Microsoft continues to add to the conversation by unveiling its newest models, Phi-4-reasoning, Phi-4-reasoning-plus, and Phi-4-mini-reasoning. Learn more.
Psychologically Plausible Deep Learning with Differentiable Tversky Similarity
When you paste ChatGPT’s response instead of your own feedback, you’re not being helpful. You’re being lazy and creating more work for everyone.
Then what happens if AI is doing the writing and reading?
Build deep agents that plan and execute complex tasks over longer time horizons. Learn the architecture behind Deep Research and Claude Code.
Personal blog of Stephen Diehl - Software engineer writing about technology, programming, and the future
Everyone’s been talking about it. JD Vance read it. What does it actually tell us?