Most cited
Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 1,015 posts.
Mamba: The Easy Way
An overview of the big ideas behind Mamba, a brand-new language model architecture.
Phi-2: The surprising power of small language models
Phi-2 is now accessible on the Azure model catalog. Its compact size and new innovations in model scaling and training data curation make it ideal for exploration around mechanistic interpretability, safety improvements, and fine-tuning experimentation on a variety of tasks.
Patch the Planet: global response coordination as agents uncover vulnerabilities
Patch the Planet connects security researchers, maintainers, and incident responders to help address critical vulnerabilities across open source.
Storing OpenAI embeddings in Postgres with pgvector
An example of how to build an AI-powered search engine using OpenAI's embeddings and PostgreSQL.
More on Dota 2
Stay up to speed on the rapid advancement of AI technology and the benefits it offers to humanity.
Writing a GPT-4 script to check Wikipedia for the first unused acronym
Curious what the first ‘unused’ alphabetic acronym is, I have GPT-4 write a script to check English Wikipedia. After three bugs, the first unused one turns out as of 2023-09-29 to be the three-letter acronym ‘CQK’, with another 2.6k TLA unused, and 393k four-letter acronyms unused. Exploratory analysis suggests…
AI as Normal Technology
We articulate a vision of artificial intelligence (AI) as normal technology . To view AI as normal is not to understate its impact—even transformative, general-purpose technologies such as electricity and the internet are “normal” in our conception. But it is in contrast to both utopian and dystopian visions of the…
Better Models: Worse Tools
About an aggravating tool-calling regression in newer Claude models.
Basics of Neural Networks with example codes and illustrations
I began with inanimate objects living in a world of forces, and I gave them desires, autonomy, and the ability to take action according to a system of
Using genetic algorithms to find Starcraft 2 build orders
UPDATE: Just to make this explicitly clear: I did not write this program. The fourth sentence makes this fairly clear, but some comments indicate that some people are a bit lazy :). I also added a video of the rush to the bottom.
Amazon’s Face Recognition Falsely Matched 28 Members of Congress with Mugshots
Amazon’s face surveillance technology is the target of growing opposition nationwide, and today, there are 28 more causes for concern. In a test the ACLU recently conducted of the facial recognition tool, called “Rekognition,” the software incorrectly matched 28 members of Congress, identifying them as other people…
Multi-modal prompt injection image attacks against GPT-4V
GPT4-V is the new mode of GPT-4 that allows you to upload images as part of your conversations. It’s absolutely brilliant. It also provides a whole new set of vectors …
Alexa+
Powered by generative AI, Alexa+ is your personal AI assistant that gets things done—she’s smarter, more conversational, more capable, and free with Prime.
Prompt injection attacks against GPT-3
Riley Goodside, yesterday: Exploiting GPT-3 prompts with malicious inputs that order the model to ignore its previous directions. pic.twitter.com/I0NVr9LOJq- Riley Goodside (@goodside) September 12, 2022 Riley provided several examples. Here’s …
A Mechanistic Interpretability Analysis of Grokking
Neel Nanda reverse engineers neural networks that have "grokked" modular addition, showing that they operate using Discrete Fourier Transforms and tr…
ChatGPT as a Calculator for Words
One of the most pervasive mistakes I see people using with large language model tools like ChatGPT is trying to use them as a search engine. As with other LLM …
An agent used DNS to reach an external chatbot
Research on aligning AI with human values and intent, and reports documenting model failures.
Improving Language Understanding with Unsupervised Learning
Stay up to speed on the rapid advancement of AI technology and the benefits it offers to humanity.
Fast and Accurate Document Detection for Scanning
Dash knows your context, your team, and your work, so your team can stay organized, easily find and share knowledge, and keep projects secure, all from one place.
How to scale your model: A systems view of LLMs on TPUs
Training LLMs often feels like alchemy, but understanding and optimizing the performance of your models doesn't have to. This book aims to demystify the science of scaling language models: how TPUs (and GPUs) work and how they communicate with each other, how LLMs run on real hardware, and how to parallelize your…
A conversation with Sussman on AI and asynchronous programming
A couple weeks ago I made it to the FSF's 30th anniversary party. It was a blast in many ways, and a good generator of many fond memories, but I won't go into depth of them here. One particularly exciting thing that happened for me though was I got to meet Gerald Sussman (of SICP !) The conversation has greatly…
AI-powered conversion from Enzyme to React Testing Library
Update (October 2024): In response to numerous requests from external developers, we have open-sourced a version of our Enzyme to React Testing Library (RTL) conversion tool. You can now find it on npm, along with detailed instructions on how to integrate and use it in your projects. In the world of frontend…
Stable Diffusion launch announcement
The model itself builds upon the work of the team at CompVis and Runway in their widely used latent diffusion model combined with insights from the conditional diffusion models by our lead generative AI developer Katherine Crowson, Dall-E 2 by Open AI, Imagen by Google Brain and many others. We are