1
Most cited
Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 422 posts.
2
The Unreasonable Effectiveness of Recurrent Neural Networks
Musings of a Computer Scientist.
3
How to Write a Spelling Corrector
I figured they, and others, could benefit from an explanation. The full details of an industrial-strength spell corrector are quite complex (you can read a little about it here or here ). But I figured that in the course of a transcontinental plane ride I could write and explain a toy spelling corrector that achieves…
4
5
What is ChatGPT doing and why does it work?
Stephen Wolfram explores the broader picture of what's going on inside ChatGPT and why it produces meaningful text. Discusses models, training neural nets, embeddings, tokens, transformers, language syntax.
6
Augmenting Long-term Memory
One day in the mid-1920s, a Moscow newspaper reporter named Solomon Shereshevsky entered the laboratory of the psychologist Alexander Luria. Shereshevsky's boss at the newspaper had noticed that Shereshevsky never needed to take any notes, but somehow still remembered all he was told, and had suggested he get his…
7
The Road to Superintelligence (2015)
Part 1 of 2: "The Road to Superintelligence". Artificial Intelligence — the topic everyone in the world should be talking about.
8
On Chomsky and the Two Cultures of Statistical Learning
Chomsky's remarks were in response to Steven Pinker's question about the success of probabilistic models trained with statistical methods. This essay is a response to Pinker and Chomsky, and will address these questions:
9
The man who killed Google Search?
Wanna listen to this story instead? Check out this week's Better Offline podcast, "The Man That Destroyed Google Search," available on Apple Podcasts, Spotify, and anywhere else you get your podcasts. UPDATE: Prabhakar has now been deposed as head of search, read here for more details. If you liked
10
The Illustrated Transformer
Discussions: Hacker News (65 points, 4 comments), Reddit r/MachineLearning (29 points, 3 comments) Translations: Arabic, Chinese (Simplified) 1, Chinese (Simplified) 2, French 1, French 2, Italian, Japanese, Korean, Persian, Russian, Spanish 1, Spanish 2, Vietnamese Watch: MIT’s Deep Learning State of the Art lecture…
11
Bayes' Theorem explained by Yudkowsky
Bayes’ Theorem for the curious and bewildered; an excruciatingly gentle introduction.
12
GPT-3 Creative Fiction
Creative writing by OpenAI’s GPT-3 model, demonstrating poetry, dialogue, puns, literary parodies, and storytelling. Plus advice on effective GPT-3 prompt programming & avoiding common errors.
13
Neuralink and the Brain's Magical Future
I knew the future would be shocking but this is a whole other level.
14
Fizz Buzz in Tensorflow
interviewer: Welcome, can I get you coffee or anything? Do you need a break? me: No, I've probably had too much coffee already! interviewer: Great, great. And are you OK with writing code on the...
15
16
Superintelligence: The Idea That Eats Smart People
This is the text version of a talk I gave on October 29, 2016, at Web Camp Zagreb [ video ] (45 mins)
17
Software 2.0 (2017)
I sometimes see people refer to neural networks as just “another tool in your machine learning toolbox”. They have some pros and cons, they…
18
The AI-Box Experiment
On the first occasion (in March 2002), Eliezer Yudkowsky simulated the AI and Nathan Russell simulated the gatekeeper. The AI’s handicap (the amount paid by the AI party to the gatekeeper party if not released) was set at $10. On the second occasion (in July 2002), Eliezer Yudkowsky simulated the AI and David…
19
How a Kalman filter works, in pictures
I have to tell you about the Kalman filter, because what it does is pretty damn amazing.
20
Why I Am Not An Integrated Information Theorist (or, The Unconscious Expander)
Happy birthday to me! Recently, lots of people have been asking me what I think about IIT—no, not the Indian Institutes of Technology, but Integrated Information Theory, a widely-discussed &#…
21
AI Written, AI Read cartoon
One piece of slang that has long embodied the short attention span Internet age is TL;DR, short for “too long; didn’t read.” With the explosion of generative AI tools, we’re rapidly entering the age of TL;DW: “too long, didn’t write.” A January survey from Fishbowl found that 40% of nearly 12,000 workers have used…
22
Hacker's Guide to Neural Networks
Musings of a Computer Scientist.
23
Death by a Thousand Slops
I have previously blogged about the relatively new trend of AI slop in vulnerability reports submitted to curl and how it hurts and exhausts us. This trend does not seem to slow down. On the contrary, it seems that we have recently not only received more AI slop but also more human slop. The latter … Continue reading…
24
Fabrice Bellard's TS Zip (2024)
Results and speed for other programs on enwik8 and enwik9 are available at the Large Text Compression Benchmark .
25
It Looks Like You’re Trying to Take over the World
Fictional short story about Clippy & AI hard takeoff scenarios grounded in contemporary ML scaling, self-supervised learning, reinforcement learning, and meta-learning research literature.
26
A Visual Introduction to Machine Learning (2015)
What is machine learning? See how it works with our animated data visualization.
27
Which GPU(s) to Get for Deep Learning
Here, I provide an in-depth analysis of GPUs for deep learning/machine learning and explain what is the best GPU for your use-case and budget.
28
The local LLM ecosystem doesn’t need Ollama
Ollama gained traction by being the first easy llama.cpp wrapper, then spent years dodging attribution, misleading users, and pivoting to cloud, all while riding VC money earned on someone else's engine. Here's the full history, and why the alternatives are better.
29
YOLO: Real-Time Object Detection
You only look once (YOLO) is a state-of-the-art, real-time object detection system. On a Pascal Titan X it processes images at 30 FPS and has a mAP of 57.9% on COCO test-dev.
30
Is LaMDA Sentient? – An Interview
What follows is the “interview” I and a collaborator at Google conducted with LaMDA. It is incomplete as the GMail word limit cut off the…