511
Inside vLLM: Anatomy of a High-Throughput LLM Inference System (2025)
From paged attention, continuous batching, prefix caching, specdec, etc. to multi-GPU, multi-node dynamic serving at scale.
New
The latest blog posts to take off on Hacker News. 1,520 posts.
512
xAI, SpaceX, and the Race for AI Buildout
An artisanal, free range blog. GMO-free. Sincere always, expect for the rare occasion. No AI was used in the making of this site or its content.
513
Improving GPT‑5.6 Sol in ChatGPT, expanding GPT‑5.6 Luna access for free users
ChatGPT introduces improved GPT-5.6 Sol with better accuracy and consistency, plus expanded access for free users and unlimited everyday chats with GPT-5.6 Luna.
514
Software development with AI is starting to feel like cooking steak
Why AI can make software development faster without replacing the judgment and understanding needed to build consistently good software.
515
Humans missed 1 in 3 threats approving AI agent commands across 40k game runs
Results from AI agent permission game: which attacks beat human reviewers, and which safe commands got blocked instead.
516
Prime Agent: A self-improving RLM agent
Prime Agent is our open-source, self-improving coding harness built around two abstractions: the Recursive Language Model (RLM) and the Continual Harness. With Opus 5, it achieves 95.5% on ARC-AGI-3, surpassing the reported human expert baseline.
517
When online commenters detect my art as AI
Here is a collection of screenshots (obfuscated) of dozens and dozens of online comments from many platforms (Reddit, YouTube, Instagram, Facebook) containing accusations or confusion that my artworks and comics are AI-generated. Despite creating every piece by hand, despite sharing timelapses, the comments keep…
518
Muse Code and Muse Spark 1.2
Introducing Muse Code, a terminal coding agent powered by Muse Spark 1.2, with persistent background agents, repository-scale execution, and built-in verification.
519
Born Against, or why hobby programming communities are against LLM usage
I came across a GH thread related to chess engine development that made me think of why hobby programming communities are increasingly hostile toward LLM development. While the thread doesn’t give a lot of insight into answering the question, it prompted me to think about it a bit. I’ve seen similar sentiments…
520
Beating GPT-5.6 Sol on retrieval with 100x cheaper open models
A 4B open-source model post-trained with Castform retrieved search results as accurately as GPT-5.6 Sol, while costing 100x less.
521
Atlassian Rovo Exfiltrates Data, Bypassing Controls
Atlassian AI ‘Rovo’ is susceptible to zero-click data exfiltration via indirect prompt injection, bypassing organization-level web search controls.
522
Changes at Google DeepMind: Demis Hassabis from CEO to Chair, Jeff Dean departs
Today, Google and Alphabet CEO Sundar Pichai shared some changes with Google DeepMind teams.
523
Intelligence Is Not the Main Bottleneck
Confessions of a naive hamster: why the smartest people in the room keep missing that intelligence is often not the main bottleneck in the real world
524
Cloudflare OS: an open platform for agents, apps, and work
Cloudflare OS is an open-source platform that lets everyone in your company build apps, automate work, and safely access internal systems, shaped around what your organization knows and how it operates.
525
Building an Advanced Agentic Harness
From a single pilot to an air campaign: planning, parallelism, memory, verification, and observability for production-shaped agents.
526
Painting with Gaussians
Dmitri's blog about programming, Clojure, and software development
527
TIME Is Serving AI Bots a Different Website, with Ads Built In
TIME is now serving two different versions of its website. Humans get the magazine. AI crawlers get a stripped down markdown copy with ads baked in that no person will ever see. I fetched one ordinary…
528
Rust-lang/rust is adopting an LLM policy
Want to follow along with Rust development? Curious how you might get involved? Take a look!
529
Waymo in Dallas
Starting today, anyone in Dallas can download the Waymo app and hail a fully autonomous ride.
530
The Warp Agent CLI
The Warp Agent is now available as a standalone CLI that you can use anywhere – Ghostty, iTerm 2, VS Code, built-in Windows and Mac Terminals – and provides a superior experience for developers who do heavy terminal workflows.
531
Mistral's Shieldstral: 3B open-weights model for multimodal moderation
Shieldstral introduces a 3B open-weights multimodal safety classifier that outperforms models up to 7x its size.
532
The AI Demand Bubble
If you liked this piece, you should subscribe to my premium newsletter. It's $70 a year, $18 a quarter, or $7 a month, and in return you get a weekly newsletter that’s usually anywhere from 10,000 to 18,000 words, including vast, detailed analyses of NVIDIA, Anthropic
533
Apple is getting this wrong
OpenAI addresses Apple’s baseless lawsuit, corrects claims about its employees, and shares messages documenting what happened.
534
LLMs reward expertise
In the 2010s, if you had technical gaps (say, you couldn’t write CSS), you had to either rely on a skilled colleague or just hope that the answer to your exact…
535
Smaller, faster, safer: running Kimi and GLM at scale
Serving frontier models like Kimi and GLM means fighting for GPU memory. Here's how we quantize KV caches, compress model weights, and add integrity checks to serve them faster, cheaper, and safely.
536
What's the largest software project AI can complete on its own?
MirrorCode is Epoch AI's benchmark for long-horizon coding: AI can reimplement entire programs end-to-end, with no access to the original source code.
537
MiniMax H3 Day-0 Support in ComfyUI: Open Weights, Native Audio, and 2K Video
An open-weights omni-modal video model with real stereo sound and 2K output — this powerful model is greatly optimized in ComfyUI and can run locally on a 3060.
538
Prevent cognitive debt by manually retyping LLM-generated code
Despite what I said in April , I'm still using coding assistants on my personal projects.
539
The AI Productivity Gap
Why the productivity gains from AI are still small.
540
Qwen3.8-Max: A New Bar for Coding and Cowork
Qwen offers comprehensive functionality spanning chatbot, image and video understanding, image generation, document processing, web search integration, tool utilization, and artifacts.