1
GPT-3 Creative Fiction
Creative writing by OpenAI’s GPT-3 model, demonstrating poetry, dialogue, puns, literary parodies, and storytelling. Plus advice on effective GPT-3 prompt programming & avoiding common errors.
Most cited
Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 34 posts.
2
Jukebox
We’re introducing Jukebox, a neural net that generates music, including rudimentary singing, as raw audio in a variety of genres and artist styles. We’re releasing the model weights and code, along with a tool to explore the generated samples.
3
OpenAI's GPT-3 Language Model: A Technical Overview
Chuan Li, PhD reviews GPT-3, the new NLP model from OpenAI. The technical overview covers how GPT-3 was trained, GPT-2 vs. GPT-3, and GPT-3 performance.
4
GPT-3
May 2020 Gwern.net newsletter: GPT-3 scaling, implications, deep theory; anime GAN updates, and 1 book review.
5
Which GPUs to get for deep learning
Here, I provide an in-depth analysis of GPUs for deep learning/machine learning and explain what is the best GPU for your use-case and budget.
6
Accelerating TensorFlow Performance on Mac
Accelerating TensorFlow 2 performance on Mac
7
GPUDirect Storage: A Direct Path Between Storage and GPU Memory
As AI and HPC datasets continue to increase in size, the time spent loading data for a given application begins to place a strain on the total application’s performance. When considering end-to-end…
8
AlphaFold: a solution to a 50-year-old grand challenge in biology
Proteins are essential to life, supporting practically all its functions. They are large complex molecules, made up of chains of amino acids, and what a protein does largely depends on its unique 3D structure. Figuring out what shapes proteins fold into is known as the “protein-folding problem”, and has stood as a…
9
Named Tensors
Named tensors for better deep learning code.
10
Giving GPT-3 a Turing Test
I’ve been playing around with OpenAI’s new GPT-3 language model. When I got beta access, the first thing I wondered was, how human is GPT-3? How close is it ...
11
12
13
Teaching GPT-3 to Identify Nonsense
In Giving GPT-3 a Turing Test, Kevin Lacker found that GPT-3 does well answering simple factual questions like “Who was president of the United States in 1955?”, but also happily answered absurd qu…
14
AlphaFold: Using AI for Scientific Discovery
In our study published in Nature, we demonstrate how artificial intelligence research can drive and accelerate new scientific discoveries. We’ve built a dedicated, interdisciplinary team in hopes of using AI to push basic research forward: bringing together experts from the fields of structural biology, physics, and…
15
16
Using neural networks to solve advanced mathematics equations
Facebook AI has developed the first neural network that uses symbolic reasoning to solve advanced mathematics problems.
17
Image Scaling Attacks
This post is part of a series about machine learning and artificial intelligence. Click on the blog tag “huskyai” to see related posts. Overview: …
18
19
Turing-NLG: A 17B-parameter language model
This figure was adapted from a similar image published in DistilBERT. Turing Natural Language Generation (T-NLG) is a 17 billion parameter language model by Microsoft that outperforms the state of the art on many downstream NLP tasks. We present a demo of the model, including its freeform generation, question…
20
Image GPT
We find that, just as a large transformer model trained on language can generate coherent text, the same exact model trained on pixel sequences can generate coherent image completions and samples. By establishing a correlation between sample quality and image classification accuracy, we show that our best generative…
21
MuZero: Mastering Go, chess, shogi and Atari without rules
In 2016, we introduced AlphaGo, the first artificial intelligence (AI) program to defeat humans at the ancient game of Go. Two years later, its successor - AlphaZero - learned from scratch to master Go, chess and shogi. Now, in a paper in the journal Nature, we describe MuZero, a significant step forward in the…
22
YOLOv5: State-of-the-art object detection at 140 FPS
YOLOv5 license and commercial-use guide: AGPL-3.0 terms, specs, resources, and alternatives. Compare YOLOv5 against other vision models free.
23
Using machine learning to recreate photorealistic portraits of Roman Emperors
Artistic interpretations of the 54 Roman emperors of the Principate, created with AI and historical references.
24
Tempering Expectations for GPT-3 and OpenAI’s API
GPT-3 is indeed a large step forward for AI text-generation, but there are very many caveats with the popular demos and use cases.
25
Quantum supremacy, now with BosonSampling
Update (12/5): The Google team, along with Gil Kalai, have raised questions about whether the results of the new BosonSampling experiment might be easier to spoof classically than the USTC team tho…
26
Understanding Convolutional Neural Networks
An interactive visualization system designed to help non-experts learn about Convolutional Neural Networks (CNNs).
27
Towards a conversational agent that can chat about anything
Posted by Daniel Adiwardana, Senior Research Engineer, and Thang Luong, Senior Research Scientist, Google Research, Brain Team Modern conversatio...
28
Reformer, the Efficient Transformer
Posted by Nikita Kitaev, Student Researcher, UC Berkeley and Łukasz Kaiser, Research Scientist, Google Research Understanding sequential data — s...
29
Training GPT-2 to Play Chess
Almost 25 years after Kasparov vs. Deep Blue, another seminal man vs. machine matchup: Neither competitor has much to be proud of here. White has a poor opening. Black screws up and loses his queen…
30
Transformers Are Graph Neural Networks
Engineer friends often ask me: Graph Deep Learning sounds great, but are there any big commercial success stories? Is it being deployed in practical applications? Besides the obvious ones–recommendation systems at Pinterest, Alibaba and Twitter–a slightly nuanced success story is the Transformer architecture, which…