If you read my previous blog post, you probably already know that I like my smart home open-source and very local, and that certainly includes any voice assistant I may have. If you watched the video demo, you have probably also found out that it’s… slow. Trust me, I did too. Prefix caching helps, but it feels like…
The complex of ideas I’m going to call the Dark Internet Forest emerges from mostly insidery tech thinking, but from multiple directions.
What Is Declarative Programming Broadly speaking, there are two ways to program/instruct a computer to perform a task, they are imperative...
A Chess-GPT Linear Emergent World Representation
Large language models (LLM) have been all the rage for quite some time now. Looking beyond the hype though, they have severe limitations: hallucinations, lack o
His boundless ambition is putting AI, and the world, on a dangerous path.
Manipulating Chess-GPT’s World Model
When I started learning about loss functions, I could always understand the intuition behind them. For example, the mean squared error (MSE) for regression seemed logical—penalizing large deviations from the ground-truth makes sense. But one thing always bothered me: I could never come up with those loss functions on…
A deep dive into evolutionary algorithms through the lens of low-poly image generation. This exploration covers genetic algorithm theory, custom Ruby implementation using the Petri Dish framework, and detailed analysis of genetic operators including roulette wheel selection, random midpoint crossover, and nudge…
Since the launch of ChatGPT, explorations in two directions kicked into high gear.
LLMs have the potential to revolutionise our field of healthcare, but the fear and reality of hallucinations prevent adoption in most applications.
A deep dive into Anthropic’s new Computer Use API.
A free survey course on LLMs, taught by practitioners.
Sam Altman is not playing around.
Buying fake William Morris prints on Etsy and other early signs of epistemological collapse
Note: In my last newsletter, I said that my next post would be the second part of my Facebook autopsy. Don’t worry, that’s still coming, but given the recent drama between Sam Altman, OpenAI, and Scarlett Johansson, I felt the need to write something. Don’t worry, I
A shift toward products and a research brain drain should ring your alarm bells
New from Loubna Ben Allal and her research team at Hugging Face: SmolLM2 is a family of compact language models available in three size: 135M, 360M, and 1.7B parameters. They …
Sparse Autoencoders (SAEs) have recently become popular for interpretability of machine learning models (although sparse dictionary learning has been around since 1997). Machine learning models and LLMs are becoming more powerful and useful, but they are still black boxes, and we don’t understand how they do the…
Google has chosen to send a response to my article to Barry Schwartz of Search Engine Roundtable. Here is my response. (1) On the March 2019 core update claim in the piece: This is baseless speculation. The March 2019 core update was designed to improve the quality of our search
I’ve been at OpenAI for almost a year now. In that time, I’ve trained a lot of generative models. More than anyone really has any right to train. As I’ve spent these hours observing the effects of tweaking various model configurations and h
OpenAI recently published a public writeup for an incident they had on December 11, and there are lots of good details in here! Here are some of my off-the-cuff observations: Saturation With thousa…
Machine learning models are rapidly becoming more capable; how can we make use of these powerful new tools in our Go applications?
Curated collection of prompts for use with LLMs. Accessible interactively in Chat Notebooks and programmatically in functions like LLMFunction. Initial categories in the Prompt Repository cover personas, functions, modifiers.
This is a set of notes on the Quinn Emanuel report on Cruise's handling of the 2023-10-02 accident where a Cruise autonomous vehicle (AV) hit a pedestrian, stopped, and then started moving again with the pedestrian stuck under the bottom of the AV, dragging the pedestrian 20 feet. After seeing some comments about this…
Posted on Monday 23 Dec 2024. 1,634 words, 1 link. By Matt Webb.
Last summer , I participated in Google Summer of Code for the first time, working with GRAME on improving support for using the Faust audio programming language on the web .
This post goes over the important and excellent new paper from Anthropic and Redwood Research, with Ryan Greenblatt as lead author, Alignment Faking in Large Language Models.
