About AI Evals
A guide to AI and LLM evals for engineers and product managers. Learn how to test AI systems, analyze failures, and improve retrieval, agents, and AI products.
The latest blog posts to take off on Hacker News. 6,329 posts.
A guide to AI and LLM evals for engineers and product managers. Learn how to test AI systems, analyze failures, and improve retrieval, agents, and AI products.
Context Engineering is the new skill in AI. It is about providing the right information and tools, in the right format, at the right time.
LLMs were invented in four major developments... all of which were datasets
the existential crisis we all share imagine this: you've just spent $640 billion training the chonkiest language model known to humanity (lol) and decide...
vLLM is an open-source inference engine that serves large language models. We deploy vLLM across GPUs and load open weight models like Llama 4 into it. vLLM sits at the intersection of AI and systems programming, so we thought that diving into its details might interest our readers.
Or: The Day My Toaster Started Taking Phone Calls
Normalizing Flows (NFs) are likelihood-based models for continuous inputs. They have demonstrated promising results on both density…
We let Claude run a small shop in the Anthropic office. Here's what happened.
QWEN CHAT DISCORD Introduction The evolution of multimodal large models is continually pushing the boundaries of what we believe technology can achieve. From the initial QwenVL to the latest Qwen2.5 VL, we have made progress in enhancing the model’s ability to understand image content. Today, we are excited to…
A call to reject the deployment and use of AI systems in Canada's public sector.
Learn how to build with Gemma 3n, a mobile-first architecture, MatFormer technology, Per-Layer Embeddings, and new audio and vision encoders.
Up until today, all capable generative image editing models were only available as proprietary tools.
Introducing a new, unifying DNA sequence model that advances regulatory variant-effect prediction and promises to shed new light on genome function — now available via API.
How cubic reduced noisy AI code review comments with reasoning logs, fewer tools, specialized agents, and evaluation before changes reached production.
New in LM Studio 0.3.17: Model Context Protocol (MCP) Host support. Connect MCP servers to the app and use them with local models.
Build and share AI-powered apps directly in Claude. Update: Now available on Team and Enterprise plans. (July 31, 2025) Update: Upload PDFs, images, and more into your artifact.
Behavioral and cognitive patterns distinguish humans from bots. Explore interactive demos and a practical framework for invisible Proof of Human.
The current (and future) monetization strategies of "Shopify for SaaS"
I discovered a fun and strangely obvious trick for summarizing videos faster and reducing costs: just speed them up. Cheaper, faster OpenAI transcriptions with a little ffmpeg trick.
Free and open source, Gemini CLI brings Gemini directly into developers’ terminals — with unmatched access for individuals.
To create reliable agents, AI companies had to go beyond predicting the next token.
Highlights the desire to replace tokenization with a general method that better leverages compute and data. We'll see tokenization's fragility and review the Byte Latent Transformer arch.
We’re introducing an efficient, on-device robotics model with general-purpose dexterity and fast task adaptation.
A bill purporting to target the issue of misinformation and defamation caused by generative AI has mutated into something that could change the internet forever, harming speech and innovation from here on out.The Nurture Originals, Foster Art and Keep Entertainment Safe (NO FAKES) Act aims to...
I've been working with TPUs a lot recently and it's fun to see how they had such different design philosophies compared to GPUs.
Despite the hype, Model Context Protocol (MCP) isn’t magic or revolutionary. But, it’s simple, well-timed, and well-executed. At Stainless, we’re betting it’s here to stay.
New research on simulated blackmail, industrial espionage, and other misaligned behaviors in LLMs.
Documentation and guides from the team at Fly.io.
Hide your kids, hide your wife: how the Agile Industrial Complex has set us all up to be duped by AI codegen