91
I asked GPT-3 to make a presentation for me
Here's what it came up with, read by yours truly.
New
The latest blog posts to take off on Hacker News. 212 posts.
92
Why GPT-3 Matters
The sheer scale of the new GPT-3 model is hard to overstate; it’s an entire order of magnitude larger than Microsoft’s already-massive 17B parameter Turing-NLG.[1] Loading the entire model’s weights
93
OpenAI's GPT-3 Language Model: A Technical Overview
Chuan Li, PhD reviews GPT-3, the new NLP model from OpenAI. The technical overview covers how GPT-3 was trained, GPT-2 vs. GPT-3, and GPT-3 performance.
94
Tempering Expectations for GPT-3 and OpenAI’s API
GPT-3 is indeed a large step forward for AI text-generation, but there are very many caveats with the popular demos and use cases.
95
Giving GPT-3 a Turing Test
I’ve been playing around with OpenAI’s new GPT-3 language model. When I got beta access, the first thing I wondered was, how human is GPT-3? How close is it ...
96
97
Computation Graphs and Graph Computation
Research has begun to reveal many algorithms can be expressed as matrix multiplication, suggesting an unrealized connection between linear algebra and computer science. I speculate graphs are the missing piece of the puzzle. Graphs are not only useful as cognitive aides, but are suitable data structures for a wide…
98
Pixelopolis, a self-driving car demo from Google I/O built with TensorFlow-Lite
Pixelopolis is an interactive installation that showcases self-driving miniature cars powered by TensorFlow Lite. Each car is outfitted with its own Pixel phone, which used its camera to detect and understand signals from the world around it. In order to sense lanes, avoid collisions and read traffic signs, the phone…
99
Testing Firefox more efficiently with machine learning
A browser is an enormously complex piece of software, and it's always in development. About a year ago, we asked ourselves: how could we do better? Our CI relied heavily ...
100
Explaining RNNs without neural networks
This article explains how recurrent neural networks (RNN's) work without using the neural network metaphor. It uses a visually-focused data-transformation perspective to show how RNNs encode variable-length input vectors as fixed-length embeddings. Included are PyTorch implementation notebooks that use just linear…
101
Classifying 200k articles in 7 hours using NLP
Sculpt AI was built by a team of machine learning experts and SALT.agency and is a code-free AI platform. Keep reading to learn more about the benefits of this.
102
Robot Disinfects Greater Boston Food Bank
MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL), in collaboration with Ava Robotics and the Greater Boston Food Bank, designed a robot that disinfects surfaces and neutralizes aerosolized coronavirus with UV-C light. The approach uses a custom UV-C light fixture designed at CSAIL that is…
103
Algorithms Are Now Commodities
When I first started writing software, developers had to implement most of the algorithms they used; yes, hardware vendors provided libraries, but the culture was one of self-reliance (except for maths functions, which were technical and complicated).
104
105
TaBERT: A new model for understanding queries over tabular data
TaBERT is the first model that has been pretrained to learn representations for both natural language sentences and tabular data.
106
GPT-3 Creative Fiction
Creative writing by OpenAI’s GPT-3 model, demonstrating poetry, dialogue, puns, literary parodies, and storytelling. Plus advice on effective GPT-3 prompt programming & avoiding common errors.
107
Neural Supersampling for Real-Time Rendering
Real-time rendering in virtual reality presents a unique set of challenges — chief among them being the need to support...
108
Understanding Convolutional Neural Networks
An interactive visualization system designed to help non-experts learn about Convolutional Neural Networks (CNNs).
109
On moving from statistics to machine learning, the final stage of grief (2019)
I’ve spent the last few months preparing for and applying for data science jobs. It’s possible the data science world may reject me and my lack of both experience and a credential above…
110
AI predicts effective depression treatment based on brainwave patterns
Tracking brainwave patterns and symptoms in patients with depression, researchers used artificial intelligence to predict best treatment options.
111
Deep Chernoff Faces
One of my favorite ¹ concepts for multi-dimensional data visualization is the Chernoff Face . The idea here is that for a dataset with many...
112
113
Logistic regression from scratch
Deep dives into Cryptography and Privacy.
114
GPT-3
May 2020 Gwern.net newsletter: GPT-3 scaling, implications, deep theory; anime GAN updates, and 1 book review.
115
What I learned from looking at every AI/ML tool I could find
[Twitter thread, Hacker News discussion]
116
117
Tensorflow on edge, or – Building a “smart” security camera with a Raspberry Pi
The amount of time my outdoor cameras are being set off by light, wind, cars, or anything other than a human is insane. Overly cautious security cameras might be a feature, but an annoying one at that...
118
Linear Regression
From zero to linear regression
119
Hash: A free, online platform for modeling
Sometimes simulating complex systems is the best way to understand them.
120
Image GPT
We find that, just as a large transformer model trained on language can generate coherent text, the same exact model trained on pixel sequences can generate coherent image completions and samples. By establishing a correlation between sample quality and image classification accuracy, we show that our best generative…