Topics /
The most popular blog posts about ai & machine learning on Hacker News. 1,227 posts.
We discovered why language models catastrophically fail on long conversations: when old tokens are removed to save memory, models produce complete gibberish. We found models dump massive attention onto the first few tokens as "attention sinks"—places to park unused attention since softmax requires weights to sum to 1…
What is OpenAI? I realize you might say "a foundation model lab" or "the company that runs ChatGPT," but that doesn't really give the full picture of everything it’s promised, or claimed, or leaked that it was or would be. No, really, if you believe its leaks to
Proposal & discussion of how default mode networks for LLMs are an example of missing capabilities for search and novelty in contemporary AI systems.
LLMs excel at text generation but fail at precise document extraction due to nondeterminism. | Pulse AI
LLMs think WEIRD - Western, Educated, Industrialised, Rich, Democratic. STRAT7 explores what AI cultural bias means for researchers working across global markets.
I got into programming because it let me turn thought into reality. If I could reason precisely, then a computer could carry out my thoughts unerringly. I could step away from tiring, ambiguous human interaction for a while.
We’re introducing an efficient, on-device robotics model with general-purpose dexterity and fast task adaptation.
StringZilla v4 brings CUDA acceleration for string processing: 109x faster than Nvidia's CuDF on edit distances, plus 52-bit MinHash fingerprinting and AES-based hashing.
Fastly’s survey shows senior developers trust gen AI tools enough to ship 2.5x more AI code, while juniors stick to traditional coding and caution.
The Ivory Tower is a blog about software engineering and development philosophy by Anders Sundman.
Composer is our new agent model designed for software engineering intelligence and speed.
On a benchmark of real exploited contracts, AI agents found vulnerabilities worth a combined $4.6 million, underscoring the need for AI-powered defense.
The artificial intelligence boom is the most important economic story in the world. But the numbers just don't add up.
Here’s a look at what we announced at LlamaCon and how you can get started with our newest releases.
An exploration of how well AI generates system architecture diagrams
The Legit research team unearthed vulnerabilities in GitLab Duo.
Reading research papers and articles about chain-of-thought reasoning makes me frustrated. There are many interesting questions to ask about chain-of-thought…
A comprehensive solution for financial analysis that helps finance professionals analyze markets, conduct research, and make decisions.
This article contains a collection of resources for senior (or staff+) engineers exploring the use of LLM for collaborative programming.
Discover Imagen 4 Fast, Google's new speed-optimized text-to-image model, now generally available with Imagen 4 and 4 Ultra in the Gemini API.
A comprehensive overview of automotive lidar technology — what lidar measures, how it measures distance, and how it determines bearing.
OpenAI’s o3-mini is out today. As with other o-series models it’s a slightly difficult one to evaluate—we now need to decide if a prompt is best run using GPT-4o, o1, …
Even for him, his latest whopper is something
Introducing agent mode for GitHub Copilot in VS Code, announcing the general availability of Copilot Edits, and providing a first look at our SWE agent.
the existential crisis we all share imagine this: you've just spent $640 billion training the chonkiest language model known to humanity (lol) and decide...
It was a busy week in the AI world.
We're excited to announce an enhancement to Gemini CLI that makes your workflow more powerful a...
