The upcoming GPT-3 moment for RL
How RL training will scale up to thousands of diverse environments, similar to how pretraining scaled up text corpora.
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 6,329 posts.
How RL training will scale up to thousands of diverse environments, similar to how pretraining scaled up text corpora.
About an aggravating tool-calling regression in newer Claude models.
Last week, while working on new features for our product, I had to find a quick and efficient way to extract the main topics/objects from a sentence. Since I’m using Python, I initially thoug…
Writing drafts via retrieval-augmented generation. Also reflecting on the week's journal entries.
Posted by Nick Johnston and David Minnen, Software EngineersData compression is used nearly everywhere on the internet - the videos you watch onlin...
Today, we open sourced our Zero-Knowledge Proof (ZKP) libraries, fulfilling a promise and building on our partnership with Sparkasse to support EU age assurance.
I used to be one of these people. I read Yudkowsky and was like, OMG recursive self improvement hard takeoff AI is coming. Then I joined the real world and actually tried to do things. At comma, we ship a hardware product of similar complexity to a cell phone, and it’s really hard. Reality has lots of finicky details…
Large language models may be standardizing human expression and subtly influencing how we think, says study led by USC Dornsife researcher
On developing an involuntary reflex for spotting AI slop
Inside our performance sprint: the benchmarks Claude built, the loop each Slack thread ran, and the guardrails that let us ship 3,000 changes safely.
“🔄 Update: after posting this on HN, some commenters provided Stable Diffusion and Midjourney results as well which are now included.” In the recent Photoshop Betas, users are now able...
Discover Sparse Llama: A 50% pruned, GPU-optimized Llama 3.1 model with 2:4 sparsity, enabling faster, cost-effective inference without sacrificing accuracy.
We've put together an index of testing terms and articles, covering many of the basics of testing and definitions for common searches.
Scores represent the mean of the following eight benchmarks listed below, excluding xbench-DeepSearch. The Step 3.5 Flash score is derived under standard settings (i.e., $w/o$ Parallel Thinking).
A deep dive into the open weight Trinity Large model, covering architecture, sparsity, training at scale, and why we shipped Preview, Base, and TrueBase checkpoints.
Dive into the world of AI engineering with this exploration of Deep Research in report generation. Learn how LLM-as-a-judge systems, machine learning, and ev...
How I use DeepWiki to speed up real coding work
Ray Tracing Essentials is a seven-part video series hosted by the editor of Ray Tracing Gems, NVIDIA’s Eric Haines.
I began with inanimate objects living in a world of forces, and I gave them desires, autonomy, and the ability to take action according to a system of
Posted by Heng-Tze Cheng, Senior Software Engineer, Google ResearchThe human brain is a sophisticated learning machine, forming rules by memorizing...
Does AI-assisted cognition threaten human development? Explore the risks of AI-assisted thinking and learn strategies to use AI tools without freezing your critical thinking.
After reading the book The AWK Programming Language (recommended!), I was planning to try AWK out on this year’s Advent of Code. Having some time off from work this week, I tried to implement one of the problems in it to get some practice, set up my tooling, see how hard AWK would be, and… I found I’m FP-pilled.
Why coding agents perform better in cohesive ecosystems like Go than fragmented ones like JavaScript or Python
From Data to Daily Life
We benchmarked 11 data formats, including markdown tables, JSON, CSV, YAML, XML, and more, to see which LLMs understand best. We found surprising accuracy and token cost trade-offs.
As agents grow more capable, so does their potential blast radius. Here's what we learned building containment for claude.ai, Claude Code, and Cowork.
1991: T and P of ChatGPT, distillation, deep residual learning, LSTM, GAN
/prewalk hands the cheap model a trajectory, not a plan, retaining 92–97% of frontier pass rate at roughly half the cost on SWE-Bench Pro.
AI has an Instagram problem. Just as Instagram’s parade of perfect physiques makes many people feel they don’t measure up, AI’s parade of exciting...