New
The latest blog posts to take off on Hacker News. 301 posts.
Why I Am Not An Integrated Information Theorist (or, The Unconscious Expander)
Happy birthday to me! Recently, lots of people have been asking me what I think about IIT—no, not the Indian Institutes of Technology, but Integrated Information Theory, a widely-discussed &#…
Push-ups with Python, mediapipe and OpenCV
In the Singapore Army, there is something called IPPT (Individual Physical Proficiency Test). The problem with this test is not how…
Machine Learning Algorithms Cheat Sheet
Machine learning is a subfield of artificial intelligence (AI) and computer science that focuses on using data and algorithms to mimic the way people learn, progressively improving its accuracy. This way, Machine Learning is one of the most interesting methods in Computer Science these days, and it'
A gentle introduction to automated reasoning
Meet Amazon Science’s newest research area.
Faster Python calculations with Numba
Python-based calculations, especially those that use NumPy, can run much faster by using the Numba library.
Controlling the nuclear fusion plasma in a tokamak with reinforcement learning
Successfully controlling the nuclear fusion plasma in a tokamak with deep reinforcement learning
My approach to automatic musical composition
In this blog, I will introduce my approach to automatic musical composition, including the theory, the algorithm, and a Python package implementation ch0p1n .
Frank Rosenblatt's perceptron paved the way for AI 60 years too soon (2019)
As the Faculty of Computing and Information Science celebrates its 20th year, Frank Rosenblatt’s prescient research into artificial intelligence underscores Cornell’s pivotal role in computing history.
AlphaCode as a dog speaking mediocre English
Tonight, I took the time actually to read DeepMind’s AlphaCode paper, and to work through the example contest problems provided, and understand how I would’ve solved those problems, and how A…
Solving some formal math olympiad problems
We built a neural theorem prover for Lean that learned to solve a variety of challenging high-school olympiad problems, including problems from the AMC12 and AIME competitions, as well as two problems adapted from the IMO.
Competitive Programming with AlphaCode
Solving novel problems and setting a new milestone in competitive programming.
Announcing GPT-NeoX-20B
Announcing GPT-NeoX-20B, a 20 billion parameter model trained in collaboration with CoreWeave.
Simulation of a 2B-atom cell that metabolizes and grows like a living cell
Researchers from the University of Illinois developed GPU-accelerated software to simulate a cell that metabolizes and grows like a living cell.
Aligning Language Models to Follow Instructions
We’ve trained language models that are much better at following user intentions than GPT-3 while also making them more truthful and less toxic, using techniques developed through our alignment research. These InstructGPT models, which are trained with humans in the loop, are now deployed as the default language models…
Recovering redacted information from pixelated videos
We explore the history of image unblurring and present a simple yet effective technique to get a high-resolution image from a pixelated video in order to recover redacted information (with no guessing involved).
Are popular toxicity models simply profanity detectors?
Are popular toxicity models simply profanity detectors? We show how toxicity models overweight profanity, and make mistakes when profanity is used in a positive way.
Building a neural network in pure Lisp using only atoms and lists
A neural network written in pure Lisp without built-in numbers using only atoms and lists in SectorLISP, a 512-byte Lisp interpreter written by the authors of the SectorLISP project.
Google Research: Themes from 2021 and Beyond
Posted by Jeff Dean, Senior Fellow and SVP of Google Research, on behalf of the entire Google Research community Over the last several decades, I'v...
New theory proposes ‘forgetting’ is a form of learning
The scientists behind the new theory suggest that rather than being a bug, forgetting may be a functional feature of the brain, allowing it to interact dynamically with the environment to enhance decision-making.
“Chatbots: Still Dumb After All These Years”
In 1970, Marvin Minsky, recipient of the Turing Award (“the Nobel Prize of Computing”), predicted that within “three to eight years we will have a machine with the general intelligence of an average human being.”
Github Copilot Wants to Play Chess Instead of Code
When OpenAI announced GPT-3 & its public beta I was fascinated but didn’t have an API key. I played with everything free that was built with GPT-3. Naturally, when I heard about GitHub Copilot I signed up for the waitlist and a few months later, I got access!
Welcome to Waifu Labs v2: How Do AIs Create?
How does an A.I. generate waifus and husbandos? Utilizing the power of machine learning algorithms, see how we taught an A.I. to make these magic anime portraits in the form of generative art.
Procedural Worlds from Simple Tiles
In the two years after publishing this, I worked on refining this algorithm to power a real-time world generator, called Generate Worlds, and it lets you des...
Nvidia tool generates full 3D models from a single still image
Bringing together the world’s brightest minds and the latest accelerated computing technology leads to powerful breakthroughs that help tackle some of the biggest research problems....
Elixir and Machine Learning: Nx v0.1 released
A huge milestone towards Elixir and Machine Learning has been reached with the release of Nx v0.1
Neural network from scratch
In this edition of Napkin Math, we’ll invoke the spirit of the Napkin Math series to establish a mental model for how a neural network works by building one from scratch. In a future issue we will do napkin math on performance, as establishing the first-principle understanding is plenty of ground to cover for today!