Building an LLM from Scratch: Automatic Differentiation (2023)
Automatic Differentiation
Topics /
The most popular blog posts about ai & machine learning on Hacker News. 3,091 posts.
Automatic Differentiation
We are losing something precious in the age of LLMs: our unique voices.
It is not the fault of Turing, though.
tokens are going to be as cheap as electricity within the decade
Looking in more detail at Google's first Tensor Processing Unit
Note: This post comes with a NotebookLM podcast (1linked at the bottom), and three generated audio recordings. You can read the conversation I had
Restoration of distorted images is one of the most interesting and important problems of image processing - from the theoretical, as well as from the practical point of view. There are especial cases: blurring due to incorrect focus and blurring due to movement - and these very defects, which each of you knows very…
What happens when most "people" you interact with on the internet are fake?
I shouldn't have to care about this. I don't want to care about how someone's code gets into the IDE. Whether you wrote it by hand, copied it from a forum, prom
GambleAI I’ve been coding a lot with AI since November, when we all noticed it got really good. And it is quite good for instantly generating something th...
From chatbots to agents
There are three ways to do AI coding at home without spending like a company, and which one fits depends mostly on how much you trust the next year of hardwa...
Hey you, Yes, you, who are thinking about not hiring a technical writer this year or, worse, erased one or more technical …
OpenAI announced ChatGPT Work on July 9th, and have been furiously iterating on it ever since. It is an extraordinarily confusing and very powerful product. Here’s what I’ve figured out …
We're not in a February 2020 moment, and ordinary people will be fine
A big nerd debate with bigger implications for the future of work, technology, and the economy
How to run Claude Code with the `--dangerously-skip-permissions` flag in a safe way
~Will Thompson's personal website~
We solve 20% of ARC-AGI-1 with no pretraining by minimizing the description length during inference time, with the only data involved being the target puzzle itself.
A pause to take stock: realising that attention heads are simpler than I thought explained why we do the calculations we do.
Fear, FOMO, and the scientific exodus driven by ChatGPT
Anthropic may have just committed the biggest business blunder of 2026 -- and we're less than two weeks in. To understand why, let's briefly rewind to 2025, the year when agentic AI went mainstream.
Inside every AI is a bigger AI, trying to get out
This program is a dependency-free implementation of GPT-2, including byte-pair encoding and transformer inference, in ~3000 bytes of C. I then use this to create something like Chat GPT.
With Anthropic altering rate limits, we can find other places to spend our money. I have chosen Zed editor with OpenRouter for maximum flexibility.
Anthropic have enabled CORS support for their JSON APIs, which means it’s now possible to call the Claude LLMs directly from a user’s browser. This massively significant new feature is …