Compiling LLMs into a MegaKernel: A path to low-latency inference
TL;DR: We developed a compiler that automatically transforms LLM inference into a single megakernel — a fused GPU kernel that performs…
The latest blog posts to take off on Hacker News. 6,329 posts.
TL;DR: We developed a compiler that automatically transforms LLM inference into a single megakernel — a fused GPU kernel that performs…
In the 12-plus years that we’ve been turning official precinct election results into data at OpenElections , the single biggest problem has been converting pictures of results into CSV files. Many of the precinct results files we get are image PDFs, and for those there are essentially two options: data entry or…
Confused by LLMs, RAG, & AI Agents? We break down the spectrum of AI system design with a familiar resume-screening example to show the leap in capabilities (and complexity) at each level.
Connect your favorite development tools and data sources securely to Claude Code through remote MCP servers. Today, we’re announcing support for remote MCP servers in Claude Code.
Transcript of Andrej Karpathy's YC AI SUS talk at Y Combinator on June 17th, 2024.
AI Agents, Modularity, and Alignment
Table of Contents Agents Need to Interact With LLMs Agents Should Be Event-Driven Agents Need Context Agents Require Memory When SQL Is Not Enough Parting Thoughts AI Agents have improved in leaps …
Building on the recent empirical work of Kwa et al. (2025), I show that within their suite of research-engineering tasks the performance of AI agents on longer-duration tasks can be explained by an extremely simple mathematical model — a constant rate of failing during each minute a human would take
The Fall of Civilizations podcast put out a 6¾-hour episode on the history of the Mongol Empire, which I eagerly listened to. After finishing the episode I wondered about contemporary Mongolian society, I wanted to learn what the lands that the Mongol Empire exploded from are like in our current day. There are many…
Check project's website: https://www.brainonllm.comWith today's wide adoption of LLM products like ChatGPT from OpenAI, humans and businesses engage and u…
There has been rather a lot of doomsaying (and perhaps astroturfing) lately about LLMs as the end of computer programming. Much of the discussion has been lacking nuance, so I’d like to add mine. I see claims from one side that “I used $LLM_SERVICE_PROVIDER to make a small throwaway tool, so all programmers will be…
The most exciting part of Programming Languages (PL) research for me has always been in Programming Language Design.
Introduction to Kumo Relational — the relational foundation model for predictive AI on relational data
Practical guidance from Anthropic on building reliable AI agents, from simple composable patterns to fully autonomous systems.
Gemini 2.5 Flash and Pro are now generally available, and we’re introducing 2.5 Flash-Lite, our most cost-efficient and fastest 2.5 model yet.
You can now have o3 throw vastly more compute at a given problem.
Personal blog of Omar Abid
People keep asking me If I use Generative AI tools for coding and what I think of them, so this is my effort to put my thoughts in writing, so that I can send people here instead of having to repeat…
The AI era is speedrunning the Web 2.0 story. Open and accessible MCPs are not our future. Integrations will be tightly governed.
blog - kade killary
New research could have big implications for copyright lawsuits against generative AI.
Over the past few years, we've seen that next-token prediction scales, denoising diffusion scales, contrastive learning scales, and so on, all the way to the point where we can train models with billions of parameters with a scalable objective that can eat up as much data as we can throw at it. Then, what about…
Also: another paper that seals the deal
This new paper by 11 authors from organizations including IBM, Invariant Labs, ETH Zurich, Google and Microsoft is an excellent addition to the literature on prompt injection and LLM security. …
Current recommendations of agentic coding.
The first public passenger locomotive, Locomotion No. 1, began service in September 1825. The first mass-casualty railway disaster happened seventeen years…
We’re excited to share V-JEPA 2, the first world model trained on video that enables state-of-the-art understanding and prediction, as well as zero-shot planning and robot control in new environments.
A year ago, Mihail Eric wrote a blog post detailing his experiences working on AI inside Amazon: How Alexa Dropped the Ball on Being the Top Conversational System on the Planet. It’s a great …