New
The latest blog posts to take off on Hacker News. 6,335 posts.
Simulation of a 2B-atom cell that metabolizes and grows like a living cell
Researchers from the University of Illinois developed GPU-accelerated software to simulate a cell that metabolizes and grows like a living cell.
Aligning Language Models to Follow Instructions
We’ve trained language models that are much better at following user intentions than GPT-3 while also making them more truthful and less toxic, using techniques developed through our alignment research. These InstructGPT models, which are trained with humans in the loop, are now deployed as the default language models…
Recovering redacted information from pixelated videos
We explore the history of image unblurring and present a simple yet effective technique to get a high-resolution image from a pixelated video in order to recover redacted information (with no guessing involved).
Are popular toxicity models simply profanity detectors?
Are popular toxicity models simply profanity detectors? We show how toxicity models overweight profanity, and make mistakes when profanity is used in a positive way.
Building a neural network in pure Lisp using only atoms and lists
A neural network written in pure Lisp without built-in numbers using only atoms and lists in SectorLISP, a 512-byte Lisp interpreter written by the authors of the SectorLISP project.
Google Research: Themes from 2021 and Beyond
Posted by Jeff Dean, Senior Fellow and SVP of Google Research, on behalf of the entire Google Research community Over the last several decades, I'v...
New theory proposes ‘forgetting’ is a form of learning
The scientists behind the new theory suggest that rather than being a bug, forgetting may be a functional feature of the brain, allowing it to interact dynamically with the environment to enhance decision-making.
“Chatbots: Still Dumb After All These Years”
In 1970, Marvin Minsky, recipient of the Turing Award (“the Nobel Prize of Computing”), predicted that within “three to eight years we will have a machine with the general intelligence of an average human being.”
Github Copilot Wants to Play Chess Instead of Code
When OpenAI announced GPT-3 & its public beta I was fascinated but didn’t have an API key. I played with everything free that was built with GPT-3. Naturally, when I heard about GitHub Copilot I signed up for the waitlist and a few months later, I got access!
Welcome to Waifu Labs v2: How Do AIs Create?
How does an A.I. generate waifus and husbandos? Utilizing the power of machine learning algorithms, see how we taught an A.I. to make these magic anime portraits in the form of generative art.
Procedural Worlds from Simple Tiles
In the two years after publishing this, I worked on refining this algorithm to power a real-time world generator, called Generate Worlds, and it lets you des...
Nvidia tool generates full 3D models from a single still image
Bringing together the world’s brightest minds and the latest accelerated computing technology leads to powerful breakthroughs that help tackle some of the biggest research problems....
Elixir and Machine Learning: Nx v0.1 released
A huge milestone towards Elixir and Machine Learning has been reached with the release of Nx v0.1
Neural network from scratch
In this edition of Napkin Math, we’ll invoke the spirit of the Napkin Math series to establish a mental model for how a neural network works by building one from scratch. In a future issue we will do napkin math on performance, as establishing the first-principle understanding is plenty of ground to cover for today!
Visualizing Bayes Theorem (2009)
I recently came up with what I think is an intuitive way to explain Bayes’ Theorem. I searched in google for a while and could not find any article that explains it in this particular way.
Grok {Shan, Shui}*: Advent of understanding the generative art
I spent 24 days digging into the code of {Shan, Shui}* Chinese painting generator and lived to tell the story.
Trade-Offs in Automatic Differentiation: TensorFlow, PyTorch, Jax, and Julia
To understand the differences between automatic differentiation libraries, let’s talk about the engineering trade-offs that were made. I would personally say that none of these libraries are “better” than another, they simply all make engineering trade-offs based on the domains and use cases they were aiming to…
Inverting PhotoDNA
Ribosome inverts Microsoft PhotoDNA hashes using machine learning.
The Hyperbolic Geometry of DMT Experiences (2016)
[Content Warning: Trying to understand the contents of this essay may be mind-warping. Proceed with caution. Featured image credit: Paul Nylander] Friends, right here and now, one quantum away, the…
Using AI to Animate Children’s Drawings
We’ve built a first-of-its-kind method for using AI to automatically animate children’s drawings of people.
The future of artificial intelligence is self-organizing and self-assembling
This is the first post in a series I plan to write on the work from our group and others that combines ideas from deep learning with ideas from self-organization and collective systems. In this first post, we’ll look at some of the developed approaches and the domains they have…
Find anything fast with Google's vector search technology
Recently, Google Cloud partner Groovenauts, Inc. published a live demo of MatchIt Fast . As the demo shows, you can find images and text similar to a selected sample from a collection of millions in a matter of milliseconds:
Customizing GPT-3 for Your Application
Fine-tune with a single command.
Gopher – A 280B parameter language model
Language, and its role in demonstrating and facilitating comprehension - or intelligence - is a fundamental part of being human. It gives people the ability to communicate thoughts and concepts, express ideas, create memories, and build mutual understanding. These are foundational parts of social intelligence. It’s…
How a Kalman filter works, in pictures
I have to tell you about the Kalman filter, because what it does is pretty damn amazing.
Learning with Not Enough Data: Semi-Supervised Learning
<meta http-equiv=