The Magic of Embeddings
Embeddings, why they’re useful, and how we can store and use them in Convex.
Topics /
The most popular blog posts about ai & machine learning on Hacker News. 6,333 posts.
Embeddings, why they’re useful, and how we can store and use them in Convex.
Posted by Richard C. Gerkin, Google Research, and Alexander B. Wiltschko, Google Did you ever try to measure a smell? …Until you can measure their ...
An operational guide on finetuning Llama 2, ready for commercial use.
Introducing MPT-7B, the first entry in our MosaicML Foundation Series. MPT-7B is a transformer trained from scratch on 1T tokens of text and code. It is open source, available for commercial use, and matches the quality of LLaMA-7B. MPT-7B was trained on the MosaicML platform in 9.5 days with zero human intervention…
We’re introducing a neural network called CLIP which efficiently learns visual concepts from natural language supervision. CLIP can be applied to any visual classification benchmark by simply providing the names of the visual categories to be recognized, similar to the “zero-shot” capabilities of GPT-2 and GPT-3.
This is a blog post for my recent paper on RL post-training of LLMs: introducing the Matthew Effect and proposing to solve it with Never Give Up. It is presented interactively and less formally, more like how I give the talk. For a deeper, more technical dive, check out the paper on arxiv and code on github. The…
Posted by Michael S. Ryoo, Research Scientist and AJ Piergiovanni, Student Researcher, Robotics at Google Video understanding is a challenging pr...
"That's why I'm sending this message of urgency"
We’re developing a blueprint for evaluating the risk that a large language model (LLM) could aid someone in creating a biological threat. In an evaluation involving both biology experts and students, we found that GPT-4 provides at most a mild uplift in biological threat creation accuracy. While this uplift is not…
Recent incident where Uber car was involved in an accident where a cyclist got killed has sparked many comments and opinions. Many blame…
This post is about the seventh and final video in this series, Denoising for Ray Tracing.
Small AI models may be only months away from being able to self-replicate across cheap IoT devices like Android TV boxes, with no datacenter needed.
When we first set up the llm such that it could play text adventures , we noted that none of the models we tried to use with it were any good at it. We dreamed of a way to compare them, but all I could think of was setting a goal far into the game and seeing how long it takes them to get there. I just realised there’s…
Research update on compute-efficient pretraining and scaling to trillion-parameter models.
Scaling GAIA-1: a 9-billion parameter generative world model for autonomous driving
Company crosses a dangerous line by beginning to offer AI suspicion-generation functions
It took me a few minutes to create a fake me giving a fake lecture.
A deep dive into evolutionary algorithms through the lens of low-poly image generation. This exploration covers genetic algorithm theory, custom Ruby implementation using the Petri Dish framework, and detailed analysis of genetic operators including roulette wheel selection, random midpoint crossover, and nudge…
We are excited to announce that ClickHouse has acquired LibreChat, the leading open-source AI chat platform.
In this update, we are excited to welcome the following models joining the Chatbot Arena:
One Machine Learning algorithm that relies on the concepts of proximity and similarity is K-Nearest Neighbor (KNN). KNN is a supervised learning algorithm capable of performing both classification and regression tasks.
Open source LLMs now outperform closed alternatives at 90% lower cost for workhorse tasks. We compare benchmarks, pricing, and real-world performance.