1
Most cited
Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 36 posts.
2
OpenAI LP
We’ve created OpenAI LP, a new “capped-profit” company that allows us to rapidly increase our investments in compute and talent while including checks and balances to actualize our mission.
3
OpenAI releases larger GPT-2 model
We’ve trained a large-scale unsupervised language model which generates coherent paragraphs of text, achieves state-of-the-art performance on many language modeling benchmarks, and performs rudimentary reading comprehension, machine translation, question answering, and summarization—all without task-specific training.
4
YOLO: Real-Time Object Detection
You only look once (YOLO) is a state-of-the-art, real-time object detection system. On a Pascal Titan X it processes images at 30 FPS and has a mAP of 57.9% on COCO test-dev.
5
A Recipe for Training Neural Networks
Musings of a Computer Scientist.
6
Applying BERT models to Search
How new advances in the science of language understanding will help you find more useful information in Search.
7
Transformers from Scratch
Repository for personal website
8
9
MuseNet
We’ve created MuseNet, a deep neural network that can generate 4-minute musical compositions with 10 different instruments, and can combine styles from country to Mozart to the Beatles. MuseNet was not explicitly programmed with our understanding of music, but instead discovered patterns of harmony, rhythm, and style…
10
Scott’s Supreme Quantum Supremacy FAQ
You’ve seen the stories—in the Financial Times, Technology Review, CNET, Facebook, Reddit, Twitter, or elsewhere—saying that a group at Google has now achieved quantum computation…
11
Better Language Models and Their Implications
Stay up to speed on the rapid advancement of AI technology and the benefits it offers to humanity.
12
Visual Information Theory (2015)
I love the feeling of having a new way to think about the world. I especially love when there’s some vague idea that gets formalized into a concrete concept. Information theory is a prime example of this.
13
Quantum supremacy: the gloves are off
Links:Google paper in NatureNew York Times articleIBM paper and blog post responding to Google’s announcementBoaz Barak’s new post: “Boaz’s inferior classical inferiority FA…
14
Autocompletion with Deep Learning
We've put together an index of testing terms and articles, covering many of the basics of testing and definitions for common searches.
15
AlphaStar: Mastering the Real-Time Strategy Game StarCraft II
Games have been used for decades as an important way to test and evaluate the performance of artificial intelligence systems. As capabilities have increased, the research community has sought games with increasing complexity that capture different elements of intelligence required to solve scientific and real-world…
16
Emergent Tool Use from Multi-Agent Interaction
We’ve observed agents discovering progressively more complex tool use while playing a simple game of hide-and-seek. Through training in our new simulated hide-and-seek environment, agents build a series of six distinct strategies and counterstrategies, some of which we did not know our environment supported. The…
17
DiffEqFlux.jl – A Julia Library for Neural Differential Equations
DiffEqFlux.jl – A Julia Library for Neural Differential Equations...
18
Grandmaster level in StarCraft II using multi-agent reinforcement learning
AlphaStar is the first AI to reach the top league of a widely popular esport without any game restrictions. This January, a preliminary version of AlphaStar challenged two of the world's top players in StarCraft II, one of the most enduring and popular real-time strategy video games of all time. Since then, we have…
19
The Illustrated Word2vec
Discussions: Hacker News (347 points, 37 comments), Reddit r/MachineLearning (151 points, 19 comments) Translations: Chinese (Simplified), French, Korean, Portuguese, Russian “There is in all things a pattern that is part of our universe. It has symmetry, elegance, and grace - those qualities you find always in that…
20
Solving the Rubik’s cube with a robot hand
We’ve trained a pair of neural networks to solve the Rubik’s Cube with a human-like robot hand. The neural networks are trained entirely in simulation, using the same reinforcement learning code as OpenAI Five paired with a new technique called Automatic Domain Randomization (ADR). The system can handle situations it…
21
22
23
Humans who are not concentrating are not general intelligences
Recently, OpenAI came out with a new language model that automatically synthesizes text, called GPT-2. It’s disturbingly good. You can see some examples (cherry-picked, by their own admissio…
24
Viewing Matrices and Probability as Graphs
Today I'd like to share an idea. It's a very simple idea. It's not fancy and it's certainly not new. In fact, I'm sure many of you have thought about it already. But if you haven't—and even if you have!—I hope you'll take a few minutes to enjoy it with me. Here's the idea: Every matrix corresponds to a graph. So…
25
26
Interpretable Machine Learning
Machine learning is part of our products, processes, and research. But computers usually don’t explain their predictions , which can cause many problems, ranging from trust issues to undetected bugs. This book is about making machine learning models and their decisions interpretable.
27
Deep Learning: Our Miraculous Year 1990-1991
Many of the basic ideas behind the Deep Learning Revolution were published three decades ago within fewer than 12 months in our "Annus Mirabilis" 1990-91
28
Microsoft is investing $1B in OpenAI
Microsoft is investing $1 billion in OpenAI to support us building artificial general intelligence (AGI) with widely distributed economic benefits. We’re partnering to develop a hardware and software platform within Microsoft Azure which will scale to AGI. We’ll jointly develop new Azure AI supercomputing…
29
On-Device, Real-Time Hand Tracking with MediaPipe
Posted by Valentin Bazarevsky and Fan Zhang, Research Engineers, Google Research The ability to perceive the shape and motion of hands can be a v...
30
OpenAI Releases Largest GPT-2 Text Generation Model
As the final model release of GPT-2’s staged release, we’re releasing the largest version (1.5B parameters) of GPT-2 along with code and model weights to facilitate detection of outputs of GPT-2 models. While there have been larger language models released since August, we’ve continued with our original staged release…