How big are our embeddings now and why?
Embedding sizes and architectures have changed remarkably over the past 5 years
Topics /
The most popular blog posts about ai & machine learning on Hacker News. 3,092 posts.
Embedding sizes and architectures have changed remarkably over the past 5 years
[ Update 8/2/2011 : you can play against a dumbed-down Javascript version of the bot here .]
A free survey course on LLMs, taught by practitioners.
SemiAnalysis published something of a bombshell leaked document this morning: Google “We Have No Moat, And Neither Does OpenAI”. The source of the document is vague: The text below is …
In the last two weeks I spent over a dozen hours playing poker, primarily online at pokerstarsmi.com, and live at a local casino. You can view the last 1,000 hands I played here: https://poker.rchase.com I spent at least as much time reviewing my hands with
If you liked this piece, you should subscribe to my premium newsletter. It's $70 a year, $18 a quarter, or $7 a month, and in return you get a weekly newsletter that’s usually anywhere from 10,000 to 18,000 words, including vast, detailed analyses of NVIDIA, Anthropic
David Gruber wants to know what sperm whales are saying. He thinks it might actually be possible.
Web developer and cybersecurity researcher
"Laws are spider webs through which the big flies pass and the little ones get caught." -Balzac
Computers, Machine Learning and non-machine learning
A few days ago I got a sensationally stupid email from one of those websites that most of us probably have a subscription to, but which I will not give the oxygen of publicity by linking to[1]. The…
Back in high school, I remember receiving an email for a study guide from a friend. Instead of the PDF coming attached, it was a link to a site called Dropbox.
Neural Network on a Commodore 64
Reading level: No programming knowledge required, but trying ChatGPT first is advised.
A gentle introduction to backpropagation, a method of programming neural networks
john-foreman.com is your first and best source for information about john foreman. Here you will also find topics relating to issues of general interest. We hope you find what you are looking for!
I’ve been thinking about why AI feels like such a destabilizing force for society, and it isn’t just the threat of even greater…
Sam Altman is not playing around.
My wife and I have been looking for an app to track things like habits, hobbies, and when we last did certain chores.To be honest there are probably hundreds of different habit trackers on the App Store. Next to todo list apps they are supposed to be the easiest apps to create so it is not really that surprising there…
The AI era is speedrunning the Web 2.0 story. Open and accessible MCPs are not our future. Integrations will be tightly governed.
Tailwind is great. It's a quick way to style a webpage and offers incredible flexibility. The problem is, despite Tailwind being incredibly customisable I can instantly tell when a site is using Tailwind. It has a certain look and feel that is hard to shake. A few years ago this "look and feel" was fresh and classy…
How a Few Activists Made ChatGPT Deny Basic Science
I’m an independent developer who built Punge, an on-device NSFW image detection app. The idea was simple: give people tools to manage…
You can use AI tools like Claude to help you write full-length content. By going paragraph-by-paragraph, you can direct the AI while seemingly maintaining your own voice and ideas. However, despite my attempts to use AI with writing, I’ve found that it’s harder to pull off than I thought. I can get close, but due to…
Before asking the question, how do I build AGI, you first must ask the question, what would I recognize as AGI?
Buying fake William Morris prints on Etsy and other early signs of epistemological collapse
It’s very common for machine learning practitioners to have favorite algorithms. It’s a bit irrational, since no algorithm strictly…