AI Content Generation, Part 1: Machine Learning Basics
This technology is already changing the creative industry. Here's how it works.
Topics /
The most popular blog posts about ai & machine learning on Hacker News. 3,092 posts.
This technology is already changing the creative industry. Here's how it works.
Machine learning systems are stuck in a rut Barham & Isard, HotOS’19 In this paper we argue that systems for numerical computing are stuck in a local basin of performance and programmabil…
Corruption everywhere, even in YouTube's kids content
We make micrograd fly with a little compiler magic. In this post, we’ll write a ML compiler from scratch.
I knew the future would be shocking but this is a whole other level.
Current reasoning models trained with Reinforcement Learning with Verifiable Rewards (RLVR) often rely on manually curated datasets, raising scalability concerns and potentially limiting future AI growth beyond human-defined tasks. To address this, we propose the Absolute Zero paradigm, where a single model…
Neural networks can be good at naming things, I’ve discovered. Recently I’ve been experimenting with a neural network called GPT-2, which OpenAI trained on a huge chunk of the internet. Thanks to a colab notebook implementation by Max Woolf, I’m able to fine-tune it on specific lists of data -
A machine learning craftsmanship blog.
Congratulations to the xAI team—and the advocates of the scaling laws
Why AI doom rhetoric from Anthropic, OpenAI and other tech leaders functions as hype, regulatory strategy, and a distraction from present harms.
The Unreliability of LLMs & What Lies Ahead
Robots won't replace me, but another human probably will.
…and it will look a lot like AGI. LLMs can become extremely powerful by leveraging external cognitive assets and choosing actions.
Introduction Large language models are trained on huge datasets of text to learn the relationships and contexts of words within larger documents. These relationships are what allows the model to generate text. Recently I've read concerns about LLMs being trained on copyrighted text and reproducing it. This got me…
We introduce a novel sequential modeling approach which enables learning a Large Vision Model ( LVM ) without making use of any linguistic data. To do this, we define a common format, "visual sentences", in which we can represent raw images and videos as well as annotated data sources such as semantic segmentations…
The expanded form of a testimony I prepared for Congress.
ConvNets Match Vision Transformers at Scale
At the kind invitation of Rob May and the Botchain team, I had the opportunity recently to keynote Brains and Chains, an interesting conference in New York expl
Build a program synthesis tool, to generate programs from specifications, in 20 lines of code using Rosette.
Overview # This is the first part of many posts I am writing to consolidate learnings on how to finetune Large Language Models (LLMs) to process audio, with the eventual goal of being able to build and host a LLM able to describe human voices. I am motivated to gain hands-on experience tinkering LLMs so, as much as…
Research in Software Engineering from Rahul Gopinath
The best Stratechery content from the week of October 6, 2025, including OpenAI’s Windows strategy, Sam Altman and boundless ambition, and the future of creation.
GPT-4 will change the world.
Science, sociology, and the likely financial collapse of the Generative AI bubble
The very first LLM-based product, ChatGPT, was just the ability to talk with the model itself: in other words, a pure chatbot. This is still the most popular…