As an experienced LLM user, I don't use generative LLMs often
But for what I do use LLMs for, it’s invaluable.
Topics /
The most popular blog posts about ai & machine learning on Hacker News. 674 posts.
But for what I do use LLMs for, it’s invaluable.
Last month I asked people to hack part of my YouTube video, specifically to de-pixelate the contents of a folder I had pixelated starting at the 4:57 mark. Your browser does not support the video tag. For years, people have used the censor tool to blur or pixelate out parts of videos where there's sensitive…
As everyone is well aware, the world is still going nuts trying to develop more, newer and better AI tools. Mostly by throwing absurd amounts of money at the problem. Many of those billions go towards building cheap or free services that operate at a significant loss. The tech giants that run them all are hoping to…
One paper that caught my attention a bit ago was Selective attention in hypothesis-driven data analysis by Itai Yanai and Martin Lercher. In their study, students who were given specific hypotheses to test were much less likely to notice an obvious “gorilla in the data” compared to students who explored the data…
2025 Year in Review of LLM paradigm changes
A TL;DR version of Andrej Karpathy's "Deep dive into LLMs like ChatGPT" video.
Moving on from a toy self-attention mechanism, it's time to find out how to build a real trainable one. Following Sebastian Raschka's book 'Build a Large Language Model (from Scratch)'. Part 8/??
Continual learning is a huge bottleneck
How to use AI coding assistants without letting your hard-earned engineering skills wither away.
ML, Biotech, Hardware, and Coordination Problems. Sometimes I write about hard problems and how to solve them.
A surprisingly common complaint I see from developers who have tried using LLMs for code is that they encountered a hallucination—usually the LLM inventing a method or even a full …
I believe that language models aren’t world models. It’s a weak claim — I’m not saying they’re useless, or that we’re done milking them. It’s also a fuzzy-sounding claim — with its trillion weights, who can prove that there’s something an LLM isn't a model of? But I hope to make my claim clear and persuasive enough…
It's been just over two years and two months since ChatGPT launched, and in that time we've seen Large Language Models (LLMs) blossom from a novel concept into one of the most craven cons of the 21st century — a cynical bubble inflated by OpenAI CEO Sam Altman built
I didn't misclick any buttons. My best wasn't good enough. I'm not good enough.
Together, the Bitter Lesson and Scaling Laws reveal that the god of Compute we worship is yoked to an even greater one — the god of Data.
In a recent 3Blue1Brown video series on transformer models, Grant Sanderson posed a fascinating question: How can a relatively modest embedding space of 12,288 dimensions (GPT-3) accommodate millions of distinct real-world concepts? The answer lies at the intersection of high-dimensional geometry and a remarkable…
I used AI in my plasma physics research and it didn’t go the way I expected.
AI capex is so big that it's affecting economic statistics, boosting the economy, and beginning to approach the railroad boom
I've been building MVPs and SaaS products for 15 years. Let's work together on your next project.
Will Smith is being accused of generating fake fans with AI, but it's complicated: the crowds are real, but the videos were manipulated by Smith's team and YouTube itself.
"language models will get cheaper by 10x" will not save ai subscriptions from the short squeeze
Metr recently published a paper about the impact AI tools have on open-source developer productivity[^1]. They show that when open source developers working in codebases that they are deeply familiar with use AI tools to complete a task, then they take longer to complete that task compared to other tasks where they…
“Don’t use chatbots as search engines” was great advice for several years... until it wasn’t. I wrote about how good OpenAI’s o3 was at using its Bing-backed search tool back …
After 15 years as a software engineer, I realized I had never actually built and published a game.
A friend made me aware of a reading list from A16Z containing recommendations for books, weighted towards science fiction since that’s mostly what people there read.
We are losing something precious in the age of LLMs: our unique voices.
Note: This post comes with a NotebookLM podcast (1linked at the bottom), and three generated audio recordings. You can read the conversation I had
I shouldn't have to care about this. I don't want to care about how someone's code gets into the IDE. Whether you wrote it by hand, copied it from a forum, prom
From chatbots to agents
A big nerd debate with bigger implications for the future of work, technology, and the economy