121
My approach to automatic musical composition
In this blog, I will introduce my approach to automatic musical composition, including the theory, the algorithm, and a Python package implementation ch0p1n .
122
Evaluation of TikTok vs. Instagram Reels
Why can't Meta A/B test its way back to greatness? To move Instagram beyond short-term engagement metrics, we ran a personalized human evaluation asking 100 users to compare TikTok vs. Instagram Reels. Learn why Gen Z considers Reels the place where TikToks go to die, and what Instagram should do about it.
123
124
Procedural Worlds from Simple Tiles
In the two years after publishing this, I worked on refining this algorithm to power a real-time world generator, called Generate Worlds, and it lets you des...
125
How to create a blog post title optimizer with GPT-3 and Hacker News data
GPT-3 says the title for this post is very bad.
126
127
Extracting Zooming Shots from 600 Hrs of Police Helicopter Surveillance Footage
In November of 2021, an anonymous source leaked 600 hours of police aerial surveillance footage to the non-profit transparency organization Distributed Denial of Secrets .
128
Stable Diffusion 2.0 and the Importance of Negative Prompts for Good Results
Negative prompts can be far superior than traditional prompt additions.
129
Responding to recruiter emails with GPT-3
If you’re just interested in the code, here it is.
130
Creating Shazam in Java (2010)
A couple of days ago I encountered this article: How Shazam WorksThis got me interested in how a program like Shazam works… And more importantly, how hard is...
131
132
OpenAI
I have some exciting news (for me, anyway). Starting next week, I’ll be going on leave from UT Austin for one year, to work at OpenAI. They’re the creators of the astonishing GPT-3 and …
133
Prompt injection attacks against GPT-3
Riley Goodside, yesterday: Exploiting GPT-3 prompts with malicious inputs that order the model to ignore its previous directions. pic.twitter.com/I0NVr9LOJq- Riley Goodside (@goodside) September 12, 2022 Riley provided several examples. Here’s …
134
Neural network from scratch
In this edition of Napkin Math, we’ll invoke the spirit of the Napkin Math series to establish a mental model for how a neural network works by building one from scratch. In a future issue we will do napkin math on performance, as establishing the first-principle understanding is plenty of ground to cover for today!
135
136
Google's AI doesn't understand restaurant menus
In the glorious future, every website will be chock-full of semantic metadata. Restaurants won't have a 50MB PDF explaining the chef's vision for organic cuisine - instead, they'll have little scraps of data on the HTML page like: Copied JSON to 📋⧉ JSON"hasMenuItem":{ "@type":"MenuItem", "name":"Dodo In A Bun"…
137
Building games through natural language using OpenAI’s code-DaVinci model
TL;DR: OpenAI has a new code generating model that’s improved in a number of ways and can handle nearly two times as much text (4,000 tokens.) I built several small games and applications without t…
138
Recovering redacted information from pixelated videos
We explore the history of image unblurring and present a simple yet effective technique to get a high-resolution image from a pixelated video in order to recover redacted information (with no guessing involved).
139
Solving some formal math olympiad problems
We built a neural theorem prover for Lean that learned to solve a variety of challenging high-school olympiad problems, including problems from the AMC12 and AIME competitions, as well as two problems adapted from the IMO.
140
Announcing GPT-NeoX-20B
Announcing GPT-NeoX-20B, a 20 billion parameter model trained in collaboration with CoreWeave.
141
Cloud TPU VMs are generally available
Cloud TPU VMs with Ranking & Recommendation acceleration are generally available on Google Cloud. Customers will have direct access to TPU host machines.
142
We don't know what makes things sentient–so let's stop acting like we do
Sentience is a neuroscience question, not a machine learning one.
143
Differentiable programming from scratch
Differentiable programming has become a hot research topic, and not only due to the popularity of machine learning frameworks like TensorFlow, PyTorch, and JAX. Many fields apart from machine learning are finding differentiable programming to be a useful tool for solving optimization problems. In computer graphics…
144
The hunt for the M1’s neural engine
How can you tell when software uses the Neural Engine in an M1 series Mac? How much power does it use, and what is Espresso? Mysteries unravelled.
145
Historical weather data API for machine learning, free for non-commercial
Get weather data for the past days, weeks or months
146
A 2030 Self-Driving Car Bet
It’s my honor to announce that John Carmack and I have initiated a friendly bet of $10,000* to the 501(c)(3) charity of the winner’s choice: By January 1st, 2030, completely autonomous self-driving cars meeting SAE J3016 level 5 will be commercially available for passenger
147
Text Is the Universal Interface
Roon guest-authors a post on large language models and the future of computing.
148
Nvidia tool generates full 3D models from a single still image
Bringing together the world’s brightest minds and the latest accelerated computing technology leads to powerful breakthroughs that help tackle some of the biggest research problems....
149
AI and Machine Learning – The Basics
Artificial Intelligence is a once-in-a lifetime commercial and defense game changer (download a PDF of this article here) Hundreds of billions in public and private capital is being invested in Art…
150
Push-ups with Python, mediapipe and OpenCV
In the Singapore Army, there is something called IPPT (Individual Physical Proficiency Test). The problem with this test is not how…