Top posts
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 6,335 posts.
The Magic of Embeddings
Embeddings, why they’re useful, and how we can store and use them in Convex.
Digitizing Smell: Using Molecular Maps to Understand Odor
Posted by Richard C. Gerkin, Google Research, and Alexander B. Wiltschko, Google Did you ever try to measure a smell? …Until you can measure their ...
Cookbook: Finetuning Llama 2 in your own cloud environment, privately
An operational guide on finetuning Llama 2, ready for commercial use.
MosaicML MPT-7B: A Commercially-Usable LLaMa-Quality Model
Introducing MPT-7B, the first entry in our MosaicML Foundation Series. MPT-7B is a transformer trained from scratch on 1T tokens of text and code. It is open source, available for commercial use, and matches the quality of LLaMA-7B. MPT-7B was trained on the MosaicML platform in 9.5 days with zero human intervention…
Clip: Connecting Text and Images
We’re introducing a neural network called CLIP which efficiently learns visual concepts from natural language supervision. CLIP can be applied to any visual classification benchmark by simply providing the names of the visual categories to be recognized, similar to the “zero-shot” capabilities of GPT-2 and GPT-3.
Learning to solve hard problems in RL for LLMs by never giving up
This is a blog post for my recent paper on RL post-training of LLMs: introducing the Matthew Effect and proposing to solve it with Never Give Up. It is presented interactively and less formally, more like how I give the talk. For a deeper, more technical dive, check out the paper on arxiv and code on github. The…
Video Architecture Search
Posted by Michael S. Ryoo, Research Scientist and AJ Piergiovanni, Student Researcher, Robotics at Google Video understanding is a challenging pr...
Dario Amodei – "We are near the end of the exponential" [video]
"That's why I'm sending this message of urgency"
Building an early warning system for LLM-aided biological threat creation
We’re developing a blueprint for evaluating the risk that a large language model (LLM) could aid someone in creating a biological threat. In an evaluation involving both biology experts and students, we found that GPT-4 provides at most a mild uplift in biological threat creation accuracy. While this uplift is not…
Why collision avoidance is harder for an AI-based system
Recent incident where Uber car was involved in an accident where a cyclist got killed has sparked many comments and opinions. Many blame…
Ray Tracing Essentials Part 7: Denoising for Ray Tracing
This post is about the seventh and final video in this series, Denoising for Ray Tracing.
AI models may be capable of self-replicating without access to a datacenter
Small AI models may be only months away from being able to self-replicate across cheap IoT devices like Android TV boxes, with no datacenter needed.
Evaluating LLMs playing text adventures
When we first set up the llm such that it could play text adventures , we noted that none of the models we tried to use with it were any good at it. We dreamed of a way to compare them, but all I could think of was setting a goal far into the game and seeing how long it takes them to get there. I just realised there’s…
Compute-efficient pretraining and scaling to trillion-parameter models
Research update on compute-efficient pretraining and scaling to trillion-parameter models.
Gaia-1 a 9B parameter generative world model for autonomous driving
Scaling GAIA-1: a 9-billion parameter generative world model for autonomous driving
Flock Now Using AI to Report to Police If Our Movement Patterns Are "Suspicious"
Company crosses a dangerous line by beginning to offer AI suspicion-generation functions
A quick and sobering guide to cloning yourself
It took me a few minutes to create a fake me giving a fake lecture.
Low-poly image generation using evolutionary algorithms in Ruby (2023)
A deep dive into evolutionary algorithms through the lens of low-poly image generation. This exploration covers genetic algorithm theory, custom Ruby implementation using the Petri Dish framework, and detailed analysis of genetic operators including roulette wheel selection, random midpoint crossover, and nudge…
ClickHouse acquires LibreChat, open-source AI chat platform
We are excited to announce that ClickHouse has acquired LibreChat, the leading open-source AI chat platform.
Chatbot Arena Leaderboard
In this update, we are excited to welcome the following models joining the Chatbot Arena:
K-Nearest Neighbors
One Machine Learning algorithm that relies on the concepts of proximity and similarity is K-Nearest Neighbor (KNN). KNN is a supervised learning algorithm capable of performing both classification and regression tasks.
Workhorse LLMs: Why Open Source Models Dominate Closed Source for Batch Tasks
Open source LLMs now outperform closed alternatives at 90% lower cost for workhorse tasks. We compare benchmarks, pricing, and real-world performance.