91
What every developer should know about GPU computing
A primer on GPU architecture and computing
Top posts
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 789 posts.
92
ChatGPT Explained: A normie's guide to how it works
Once you understand a few core concepts, modern chatbots are less mysterious.
93
OpenAI's misalignment and Microsoft's gain
The end of a dramatic weekend in tech is that OpenAI has split and Microsoft is partnered with one and has hired the other; this is the ultimate failure case of what should have been a for-profit c…
94
Prompt injection: what’s the worst that can happen?
Activity around building sophisticated applications on top of LLMs (Large Language Models) such as GPT-3/4/ChatGPT/etc is growing like wildfire right now. Many of these applications are potentially vulnerable to prompt …
95
PyTorch 2.0
We are excited to announce the release of PyTorch® 2.0 which we highlighted during the PyTorch Conference on 12/2/22! PyTorch 2.0 offers the same eager-mode development and user experience, while fundamentally changing and supercharging...
96
OpenAI and Microsoft extend partnership
We’re happy to announce that OpenAI and Microsoft are extending our partnership.
97
98
Do Machine Learning Models Memorize or Generalize?
An interactive introduction to grokking and mechanistic interpretability.
99
Don't believe ChatGPT – we do not offer a "phone lookup" service
TL;DR ChatGPT claims we offer an API to turn a mobile phone number into the location of the phone. We do not.
100
Teaching with AI
We’re releasing a guide for teachers using ChatGPT in their classroom—including suggested prompts, an explanation of how ChatGPT works and its limitations, the efficacy of AI detectors, and bias.
101
This Voice Doesn't Exist – Generative Voice AI
We’re deploying our own generative model which lets users design entirely new synthetic voices. Discover more about generative voice AI
102
Decomposing language models into understandable components
Interpretability research decomposing a transformer layer into thousands of interpretable features that can steer model behavior.
103
Mozilla.ai: Investing in Trustworthy AI
We’re committing $30M to build Mozilla.ai: A startup — and a community — building a trustworthy, independent, and open-source AI ecosystem. We’re o
104
105
What are transformer models and how do they work?
Explore the fundamentals of transformer models, which have revolutionized natural language processing.
106
Can LLMs learn from a single example?
We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but now we think it shows LLMs can learn effectively from a single example.
107
The expanding dark forest and generative AI
Proving you're a human on a web flooded with generative AI content
108
Patterns for building LLM-based systems and products
Evals, RAG, fine-tuning, caching, guardrails, defensive UX, and collecting user feedback.
109
Claude 2
Claude 2 brings improved performance, a 100K token context window, and 2x better harmlessness, available via API and the claude.ai beta.
110
Understanding GPT tokenizers
Large language models such as GPT-3/4, LLaMA and PaLM work in terms of tokens. They take text, convert it into tokens (integers), then predict which tokens should come next. Playing …
111
We Found an Neuron in GPT-2
Written in collaboration with Joseph Miller. See the discussion of this post over on LessWrong.
112
Could you train a ChatGPT-beating model for $85k and run it in a browser?
I think it’s now possible to train a large language model with similar functionality to GPT-3 for $85,000. And I think we might soon be able to run the resulting …
113
Teaching ChatGPT to speak my son’s invented language
Becoming fluent in my son’s invented language was too difficult for me, so I decided to see how would AI do.
114
LLaMA: A foundational, 65B-parameter large language model
Today, we’re releasing our LLaMA (Large Language Model Meta AI) foundational model with a gated release. LLaMA is more efficient and competitive with previously published models of a similar size on existing benchmarks.
115
Extracting Hacker News book recommendations with the ChatGPT API
2023-10-12: I have written a followup with some details about the process used to generate this list: Extracting HN Book Recommendations with the ChatGPT API, Vol. II
116
Software 2.0 (2017)
I sometimes see people refer to neural networks as just “another tool in your machine learning toolbox”. They have some pros and cons, they…
117
Hacking Google Bard – From Prompt Injection to Data Exfiltration
Recently Google Bard got some powerful updates, including Extensions. Extensions allow Bard to access YouTube, search for flights and hotels, and also to access …
118
119
Simply explained: How does GPT work?
By now, you have probably heard of OpenAI’s ChatGPT, or any of the alternatives GPT-3, GPT-4, Microsoft’s Bing Chat, Facebook’s LLaMa or even Google’s Bard. They are artificial intelligence programs that can participate in a conversation. Impressively smart, they can easily be mistaken for humans, and are skilled in a…
120
A visual book recommender
Recreating the used bookstore experience via contrastive learning, t-SNE, and 100M book reviews.