Top posts
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 6,335 posts.
How people talk about marijuana on Reddit: a natural language analysis
In honor of today being April 20th, I thought it would be interesting to do some NLP on Reddit comments about marijuana (shout out to…
Deterministic Quoting: Making LLMs safer for healthcare
LLMs have the potential to revolutionise our field of healthcare, but the fear and reality of hallucinations prevent adoption in most applications.
Gwern’s AI-Generated Poetry
Gwern has answered my prayers and taught GPT-2 poetry. GPT-2 is the language processing system that OpenAI announced a few weeks ago. They are keeping the full version secret, but have released a s…
Terminal-Bench-Science: Evaluating AI agents on scientific research workflows
A benchmark for evaluating AI agents on research workflows across scientific domains
Denser 3D Point Clouds in OpenSfM
We've improved OpenSfM—the technology we use to create 3D reconstructions from images. By adding post-processing, we get denser 3D point clouds resulting in better visualization, positioning, and much more.
Latent Space as a New Medium
Lately I’ve been asking myself: what might artificial intelligence be good for besides answering questions and writing code?
A 2019 Guide for Automatic Speech Recognition
Computer-based processing and identification of human voices is known as speech recognition. It can be used to authenticate users in certain systems, as well as provide instructions to smart devices like the Google Assistant, Siri or Cortana. Essentially, it works… Continue reading A 2019 Guide for Automatic Speech…
Context Engineering for Agents
Patterns for managing agent context.
Embeddings, vectors, and arithmetic
An embedding is the representation of a piece of text like a word, sentence, or paragraph. Traditionally this value is in the form of a mathematical vector - a point in space. You can think of it as analogous to coordinates on a map that just happens to have many, many dimensions.
Language Models, Word2Vec, and Efficient Softmax Approximations
The Word2Vec model has become a standard method for representing words as dense vectors. This is typically done as a preprocessing step, after which the learned vectors are fed into a discriminative model (typically an RNN) to generate predictions such as movie review sentiment, do machine translation, or even…
Small offline large language model – TinyChatEngine from MIT
BLUF : TinyChatEngine provides an off-line open-source large language model (LLM) that has been reduced in size compared to Llama2. This po...
The Biology of a Large Language Model
We investigate the internal mechanisms used by Claude 3.5 Haiku — Anthropic's lightweight production model — in a variety of contexts, using our circuit tracing methodology.
Notes on Weight Initialization for Deep Neural Networks
Neural networks involve long sequence of multiplications, usually between a matrix and a vector, say \(a*x\). The result of this sequence of multiplications will either have a huge magnitude or be reduced to 0. We can divide \(a\) by a number ( scaling_factor ) to scale down its magnitude to the right level. Proper…
MCP on AWS Lambda with MCPEngine
A virtual feature store for the modern AI stack
Faiss: A library for efficient similarity search
Visit the post for more.
Discovering Novel Algorithms with AlphaTensor
In our paper, published today in Nature, we introduce AlphaTensor, the first artificial intelligence (AI) system for discovering novel, efficient, and provably correct algorithms for fundamental tasks such as matrix multiplication. This sheds light on a 50-year-old open question in mathematics about finding the…
Zero-shot learning: Using text to more accurately identify images
WHAT THE RESEARCH IS: Zero-shot learning (ZSL) is a process by which a machine learns to recognize objects it has never seen before. Researchers at Facebook have developed a new, more accurate ZSL …
OpenCV AI Competition 2021 Highlights and Team Profiles Part 1
If social media is any indication, OpenCV AI Competition 2021 participants have really hit the ground running. The competition, sponsored by Microsoft Azure and Intel, features over 1000 developers on over 200 Phase 1 winning teams worldwide and our feeds are already buzzing with awesome videos and photos as teams…
Community Is the Future of AI
To keep knowledge open and accessible to all, we must come together to build the future of AI.
Why current LLM costs are not sustainable
AI has a cost problem. The solution that will emerge will be simpler than we expect.
AI didn't break copyright law, it just exposed how broken it was
How generative AI exposes the gap between copyright law and everyday enforcement, from fan art and private creation to commercial competition.
Google to explore alternatives to robots.txt
We’re kicking off a public discussion across the web and AI communities to develop new machine-readable means to provide web publisher choice and control.