The super effectiveness of Pokémon embeddings using only raw JSON and images
Embeddings encourage engineers to go full YOLO because it’s actually rewarding to do so!
Topics /
The most popular blog posts about ai & machine learning on Hacker News. 310 posts.
Embeddings encourage engineers to go full YOLO because it’s actually rewarding to do so!
Blog post: Answering Legal Questions with LLMs
Backpropagation is the key algorithm that makes training deep models computationally tractable. For modern neural networks, it can make training with gradient descent as much as ten million times faster, relative to a naive implementation. That’s the difference between a model taking a week to train and taking 200,000…
Lessons from An Unexpected Year in AI
Link to: https://www.nytimes.com/2024/05/24/technology/google-ai-overview-search.html
I gave a talk last month at the Story Discovery at Scale data journalism conference hosted at Stanford by Big Local News. My brief was to go deep into the …
A few days ago, Anthropic released Claude Computer Use, which is a model + code that allows Claude to control a computer. It takes screenshots to make …
Neural radiance fields provide state-of-the-art view synthesis quality but tend to be slow to render. One reason is that they make use of volume rendering, thus requiring many samples (and model queries) per ray at render time. Although this representation is flexible and easy to optimize, most real-world objects can…
Blog post of Samsja
There’s a whole lot of buzz around the new Qwen2.5-Coder Series of open source (Apache 2.0 licensed) LLM releases from Alibaba’s Qwen research team. On first impression it looks like …
Search+recs+open-ended text boxes
I am somehow very late to learning CUDA. I didn’t even know until recently that CUDA is just C++ with a small amount of extra stuff. If I had known that there is so little friction to learnin…
Divining order from the chaos
In 2023, we launched an AI-powered Chief of Staff for engineering leaders—an assistant that unified information across team tools and tracked critical project developments. Within a year, we attrac...
I've seen a couple of recent posts where the writer mentioned asking LLMs to do something with a certain probability or a certain percentage of the time. There is a particular example that stuck in my mind which I've since lost the link to (If you're the author, please get in touch so I can link through to you): The…
About a week ago, my home Internet (AT&T Fiber) went from the ~1 Gbps I pay for down to about 100 Mbps (see how I monitor my home Internet with a Pi). It wasn't too inconvenient, and I considered waiting it out to see if the speed recovered at some point, because latency was fine. But as you can see around 7/7 on that…
This post contains two unrelated announcements. Firstly, I would like to promote a useful list of resources for AI in Mathematics, that was initiated by Talia Ringer (with the crowdsourced assistan…
I’m sure we are all familiar with the idea of a technological singularity. Humans create an AI that is smart enough to create an even smarter successor. That successor then creates an even sm…
The Netscapes of AI
Bouyed by the surprisingly good performance of neural networks with quantization aware training on the CH32V003, I wondered how far this can be pushed. How much can we compress a neural network whi…
Wild ramblings, raport from the field about choosing Vector Database for a particular project and a little bit of a rant about the current state of AI and how it's perceived, why human brains are a wonder of nature, and why it's far from 'thinking' and 'consciousness'.
As part of our zoom reading group ( wow, 4.5 years old now ), we discussed a paper that uses LLMs for automatic root cause analysis (RCA) fo...
How AI Could Transform the World for the Better
Careful with those human analogies
A series on automatic differentiation in Julia. Part 1 provides an overview and defines explicit chain rules.
The **Gaussian distribution**, or **normal distribution** is a key subject in statistics, machine learning, physics, and pretty much any other field that deals with data and probability.