Responding to recruiter emails with GPT-3
If you’re just interested in the code, here it is.
The latest blog posts to take off on Hacker News. 3,092 posts.
If you’re just interested in the code, here it is.
What images were used to train Stable Diffusion's text-to-image AI model? I worked with Simon Willison to make a data browser to explore and search a sample of 12 million images.
I finally was able to try it. And I can assure you it’s impossible to create professional and useful images from a text description.
If you haven’t been paying attention to what’s going on with Stable Diffusion, you really should be. Stable Diffusion is a new “text-to-image diffusion model” that was released to the …
A state-of-the-art AI model available for everyone through a safety-centric open-source license is unheard of.
How the Dead Internet Theory is fast becoming reality thanks to zero, marginal-cost content generated at infinite scale
From Data to Daily Life
A couple of days ago I encountered this article: How Shazam WorksThis got me interested in how a program like Shazam works… And more importantly, how hard is...
When I attended NAACL, I wanted to do a little test. I had two pitches for my LLM.int8() paper. One pitch is about how I use advanced quantization methods to achieve no performance degradation transformer inference at scale that makes large models more accessible. The other pitch talks about emergent outliers in…
Is DALL-E 2 fit for use in creative work? A case study involving pixel graphics for a point-and-click adventure game.
This is a guest post, written by Zhangir Azerbayev. Zhangir is an undergraduate at Yale, majoring in computer science and mathematics. He completed this work while visiting Carnegie Mellon’s …
This image was created by an AI, MidJourney. All I had to do was type in a prompt (“wildfire”) and aspect ratio. This AI is pretty good, but nowhere near the state of the art, and AI like it are, over the next few years, going to make art like this available within seconds at […]
GPT-3 says the title for this post is very bad.
As AI creative tools are becoming widespread, the question of copyright of AI creations has also taken centre-stage. But while copyright nerds obsess over the authorship question, the issue that is…
Run your own text to image prompts with CUDA, a bunch of disk space, and an insane amount of memory.
Everybody has heard about the latest cool thing™, which is DALL·E 2 (henceforth called Dall-e). A few months ago, when the first previews started, it was basically everywhere. Now, a few weeks ago, the floodgates have been opened and lots of people on the waitlist got access - that group included me. I’ve spent a day…
Differentiable programming has become a hot research topic, and not only due to the popularity of machine learning frameworks like TensorFlow, PyTorch, and JAX. Many fields apart from machine learning are finding differentiable programming to be a useful tool for solving optimization problems. In computer graphics…
I wanted to share the attached paper on choice prediction that I recently co-authored with Itamar Simonson in case it’s of interest.
My personal website
(Disclaimer: I am a transhumanist skeptic these days, not to mention a singularity curmudgeon and a critic of Mars colonization, but I still find these ideas nice to chew on sometimes.)
One of my favourite uses for the GPT-3 AI language model is generating explanations of how code works. It’s shockingly effective at this: its training set clearly include a vast …
1990: gradient descent learns subgoals. 1991: multiple time scales and levels of abstraction. 1997: world models learn predictable abstract representations...
When I first read Google’s RETRO paper, I was skeptical. Sure, RETRO models are 25x smaller than the competition, supposedly leading to HUGE savings in training and inference costs. But what about the new trillion token “retrieval database” they added to the architcture? Surely that must add back some computational…
Apparently, the first system breakdown of a driverless robot taxi fleet occurred. In San Francisco, at least a dozen autonomous Chevrolet Bolts from GM Cruise Automation were spotted blocking the i…
Matthew Butterick
Spend enough time in the tech world and you will sooner or later find that itis a common article of faith that comput...
I have some exciting news (for me, anyway). Starting next week, I’ll be going on leave from UT Austin for one year, to work at OpenAI. They’re the creators of the astonishing GPT-3 and …
Learn how alien intelligence connects to human intelligence through science and technology using the Principle of Computational Equivalence, the ruliad, rulial space, tiny spacecraft and the Wolfram Language.
Sentience is a neuroscience question, not a machine learning one.