181
The super effectiveness of Pokémon embeddings using only raw JSON and images
Embeddings encourage engineers to go full YOLO because it’s actually rewarding to do so!
182
Answering Legal Questions with LLMs
Blog post: Answering Legal Questions with LLMs
183
Calculus on Computational Graphs: Backpropagation (2015)
Backpropagation is the key algorithm that makes training deep models computationally tractable. For modern neural networks, it can make training with gradient descent as much as ten million times faster, relative to a naive implementation. That’s the difference between a model taking a week to train and taking 200,000…
184
What I've Learned in the Past Year Spent Building an AI Video Editor
Lessons from An Unexpected Year in AI
185
186
Publishing AI Slop Is a Choice
Link to: https://www.nytimes.com/2024/05/24/technology/google-ai-overview-search.html
187
AI for Data Journalism: demonstrating what we can do with this stuff
I gave a talk last month at the Story Discovery at Scale data journalism conference hosted at Stanford by Big Local News. My brief was to go deep into the …
188
ZombAIs: From Prompt Injection to C2 with Claude Computer Use
A few days ago, Anthropic released Claude Computer Use, which is a model + code that allows Claude to control a computer. It takes screenshots to make …
189
HybridNeRF: Efficient Neural Rendering
Neural radiance fields provide state-of-the-art view synthesis quality but tend to be slow to render. One reason is that they make use of volume rendering, thus requiring many samples (and model queries) per ray at render time. Although this representation is flexible and easy to optimize, most real-world objects can…
190
Building a deep learning rig
Blog post of Samsja
191
Qwen2.5-Coder-32B is an LLM that can code well that runs on my Mac
There’s a whole lot of buzz around the new Qwen2.5-Coder Series of open source (Apache 2.0 licensed) LLM releases from Alibaba’s Qwen research team. On first impression it looks like …
192
We've been put in the vibe space
Search+recs+open-ended text boxes
193
Initial CUDA Performance Lessons
I am somehow very late to learning CUDA. I didn’t even know until recently that CUDA is just C++ with a small amount of extra stuff. If I had known that there is so little friction to learnin…
194
What Shapes Do Matrix Multiplications Like?
Divining order from the chaos
195
Building AI Products–Part I: Back-End Architecture
In 2023, we launched an AI-powered Chief of Staff for engineering leaders—an assistant that unified information across team tools and tracked critical project developments. Within a year, we attrac...
196
LLMs can't do probability
I've seen a couple of recent posts where the writer mentioned asking LLMs to do something with a certain probability or a certain percentage of the time. There is a particular example that stuck in my mind which I've since lost the link to (If you're the author, please get in touch so I can link through to you): The…
197
If AI chatbots are the future, I hate it
About a week ago, my home Internet (AT&T Fiber) went from the ~1 Gbps I pay for down to about 100 Mbps (see how I monitor my home Internet with a Pi). It wasn't too inconvenient, and I considered waiting it out to see if the speed recovered at some point, because latency was fine. But as you can see around 7/7 on that…
198
AI for math resources, and erdosproblems.com
This post contains two unrelated announcements. Firstly, I would like to promote a useful list of resources for AI in Mathematics, that was initiated by Talia Ringer (with the crowdsourced assistan…
199
200
The AI bullshit singularity
I’m sure we are all familiar with the idea of a technological singularity. Humans create an AI that is smart enough to create an even smarter successor. That successor then creates an even sm…
201
The industry structure of LLM makers
The Netscapes of AI
202
Implementing neural networks on the "3 cent" 8-bit microcontroller
Bouyed by the surprisingly good performance of neural networks with quantization aware training on the CH32V003, I wondered how far this can be pushed. How much can we compress a neural network whi…
203
Why your brain is 3 milion more times efficient than GPT-4
Wild ramblings, raport from the field about choosing Vector Database for a particular project and a little bit of a rant about the current state of AI and how it's perceived, why human brains are a wonder of nature, and why it's far from 'thinking' and 'consciousness'.
204
Looming Liability Machines (LLMs)
As part of our zoom reading group ( wow, 4.5 years old now ), we discussed a paper that uses LLMs for automatic root cause analysis (RCA) fo...
205
Machines of loving grace: How AI could transform the world for the better
How AI Could Transform the World for the Better
206
The real data wall is billions of years of evolution
Careful with those human analogies
207
Micrograd.jl
A series on automatic differentiation in Julia. Part 1 provides an overview and defines explicit chain rules.
208
209
210
Understanding Gaussians
The **Gaussian distribution**, or **normal distribution** is a key subject in statistics, machine learning, physics, and pretty much any other field that deals with data and probability.