Topics /
The most popular blog posts about ai & machine learning on Hacker News. 310 posts.
Recently, GDM released a great paper titled, Scaling Exponents Across Parameterizations and Optimizers, in which they conduct over 10,000 LLM training runs to obtain optimal hyperparameters under different regimes. After reading it (it was great), I wanted to test my understanding of the paper by tallying up all…
There is a new clear best (non-tiny) LLM.
I attended the Story Discovery At Scale data journalism conference at Stanford this week. One of the perennial hot topics at any journalism conference concerns data extraction: how can we …
how developmental biology might contain the secrets to life, intelligence, and immortality
Physics likes optimization! Subject to its boundary conditions, the time evolution of a physical system is a critical point for a quantity called an action. This point of view sets the stage for Noether's principle , a remarkable correspondence between continuous invariances of the action and conservation laws of the…
Since 1984 a secretive AI project has been building a massive knowledge base to enable human-like reasoning. Will it work?
A deep dive into a new reasoning technique called Entropix.
Scalable high-resolution (megapixel) pixel-space image synthesis.
An overview of the big ideas behind Mamba, a brand-new language model architecture.
The State Space Model taking on Transformers
Modern AI rewards being very weird.
There are many potential ways to use AI 1 (and computers in general) for 2D animation. I’m currently interested in a seemingly conservative goal: to improve the productivity of a traditional hand-drawn full animation workflow by AI assuming responsibilities similar to those of a human assistant.
ts_sms works similarly to ts_zip . It uses a specific padding system compatible with arithmetic coding so that the message length does not need to be explicitly encoded.
We often think of the same information at different levels or abstraction. Here's a simple example:
Freeways were supposed to be easy. What happened?
Humane AI (Humane, hereafter) combines the mid-2010s failed concept of using a laser projector to project on the body with the early 2000s failed projector phone (something I wrote about in 2013), …
In the previous two golden ages (1950s-1960s and the 1980s), our expectations outpaced the capabilities of the technology at the time, leading to disappointment. In contrast, the AI technology of the current golden age, which began in the mid-2010s, has consistently exceeded our expectations.
Maps Mania is a blog dedicated to tracking the very best digital interactive maps on the internet and the tools used to create them.
In the past months, Tesla has been offering a free, one-month trial of their full self-driving (FSD) system to all current owners. It looks like they are rolling this out in stages, because I only got mine only a few days ago.
One of the use cases I thought was reasonable to expect from ChatGPT and Friends (LLMs) was summarising. It turns out I was wrong. What ChatGPT isn’t summarising at all, it only looks like it…
A Blogpost series about Model Architectures Part 1: What happened to BERT and T5? Thoughts on Transformer Encoders, PrefixLM and Denoising objectives
Here I’ll try to explain the coolest ideas in each of AlphaProof’s IMO 2024 solutions. AlphaProof produces proofs in Lean, and each Lean proof is composed of a series of tactics. So I’ll pick out the tactics that correspond to these ideas in the proofs for problems 1, 2 and 6 (the three problems that AlphaProof…
Why I worry about the effect GitHub Copilot is having and will continue to have on the accessibility of the web at scale.
Posted on Friday 31 May 2024. 2,785 words, 28 links. By Matt Webb.
The more I learn about AI markets, the less I think I know. I list questions and some thoughts.
I had free access to GitHub Copilot for about a year, I used it, got used to it, and slowly started to take it for granted, until one day it was taken away. I had to re-adapt to a life without Copilot, but it also gave me a chance to look back at how I used Copilot, and reflect - had Copilot actually been helpful to…
