Facts will not save you – AI, history and Soviet sci-fi
AI, history, and Soviet sci-fi
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 3,091 posts.
AI, history, and Soviet sci-fi
An introduction to learned image compression using neural networks.
A series of patterns for building an AI co-pilot application.
Why the HJB is Bellman's equation in continuous time, why continuous time matters, and how to solve the resulting control problem with neural policy iteration.
I trained a BERT model (Devlin et al, 2019) from scratch on my desktop PC (which has a Nvidia 3060 Ti 8GB GPU). The model architecture, tokenizer, and trainer all came from Hugging Face libraries, and my contribution was mainly setting up the code, setting up the data (~20GB uncompressed text), and leaving my computer…
Explore how Shazam and song identification work through interactive visualizations: spectrograms, constellation maps, hash fingerprints, and time-offset matching.
Embeddings encourage engineers to go full YOLO because it’s actually rewarding to do so!
Using JavaScript, we implement the k-Nearest Neighbors algorithm from the bottom up.
This post explores some concepts behind Gaussian processes, such as stochastic processes and the kernel function. We will build up deeper understanding of Gaussian process regression by implementing them from scratch using Python and NumPy.
Or "Why we're all in denial about the robot apocalypse"
The reasons why I don’t give permission for material I’ve written to be used as training data for an LLM chatbot designed to do Christian apologetics
Mimicry but not thought, sophistry but not understanding
Blog post: Answering Legal Questions with LLMs
If you thought the 2008 bank bailout was bad, wait til you see the 2026 AI bailout
At long last, a real-world use case for AI!
Proton's CEO called a request for security testing "loser thinking". Using AI to write code is fine, but for a privacy company, the guardrails around that code are the product.
Or: The Day My Toaster Started Taking Phone Calls
This blog post compares deep learning to the brain and derives an estimate of computational power for the brain which is used to predict the singularity.
In this edition of the newsletter, we direct our attention to one of the most prominent highlights of the summer: the release of the Llama 2 base and chat models, as well as CodeLlama, the latest highlights in the open-source AI large language model (LLM) landscape.
Backpropagation is the key algorithm that makes training deep models computationally tractable. For modern neural networks, it can make training with gradient descent as much as ten million times faster, relative to a naive implementation. That’s the difference between a model taking a week to train and taking 200,000…
In this blogpost I explore how ODE’s can be used to solve data modelling problems. I take a deep dive into the data modelling problem at hand and present ODE...
My aim here is to test my understanding of Karpathy’s great blog post “Hacker’s guide to Neural Networks” as well as of Python, to get a hang of which I rece...
In this second installment of the machine learning from scratch we switch the point of view from regression to classification: instead of estimating a number, we will be trying to guess which of 2 possible classes a given input belongs to. A modern example is looking at a photo and deciding if its a cat or a dog.
In one of the side plots to The Lord of the Rings , two of the Hobbits attempt to rouse Treebeard—a wise but ponderous sentient tree—to defend his forest from an army that is cutting it down. The problem is that Treebeard operates at a very different speed than the Hobbits. It takes him a full day simply to say hello…
The conversation isn’t over, but I don’t think I have much to add to it.