Overcoming the limits of current LLMs
Large language models (LLM) have been all the rage for quite some time now. Looking beyond the hype though, they have severe limitations: hallucinations, lack o
Topics /
The most popular blog posts about ai & machine learning on Hacker News. 3,092 posts.
Large language models (LLM) have been all the rage for quite some time now. Looking beyond the hype though, they have severe limitations: hallucinations, lack o
His boundless ambition is putting AI, and the world, on a dangerous path.
[Content Warning: Trying to understand the contents of this essay may be mind-warping. Proceed with caution. Featured image credit: Paul Nylander] Friends, right here and now, one quantum away, the…
The agentic loop—generate, assess, improve—seems like a natural fit for iterating on pelicans on bicycles.
Like many developers, I find myself more and more using AI agents to help with software development. I currently use Claude Code, the co...
I built an (almost) fully self-hosted, sandboxed, agentic software factory.
Most of the discourse about the environmental impact of LLM use focuses on a ‘median query.’ What about a Claude Code session?
Improving artificial intelligence research with scientific testing, design practice, and meta-rational choice of methods and criteria
Recently, I've been thinking a lot about scaffolding and languages for managing systems of LLMs coordinating with each other — new programming languages might be the ideal solution for this area.
A now-deleted report by HonestAGI on GitHub showed a high number of similarities between Huawei’s Pangu and Qwen 2.5.
A critical benchmark for image generation models: A partially eaten burrito with cheese, sour cream, guacamole, lettuce, salsa, pinto beans, and chicken.
My personal website
When you play Chess, there are on average something like 30 different moves you can make each turn. In other words, the branching factor is ...
To reject gods and spirits is easy: just bully them away in the name of science.
Reconstructing films with artificial neural networks
Manipulating Chess-GPT’s World Model
AI Agents, Modularity, and Alignment
When I started learning about loss functions, I could always understand the intuition behind them. For example, the mean squared error (MSE) for regression seemed logical—penalizing large deviations from the ground-truth makes sense. But one thing always bothered me: I could never come up with those loss functions on…
Or, for fucks sake, DL people, leave language alone and stop saying you solve it.
This is a blog post for my recent paper on RL post-training of LLMs: introducing the Matthew Effect and proposing to solve it with Never Give Up. It is presented interactively and less formally, more like how I give the talk. For a deeper, more technical dive, check out the paper on arxiv and code on github. The…
"That's why I'm sending this message of urgency"
Recent incident where Uber car was involved in an accident where a cyclist got killed has sparked many comments and opinions. Many blame…
When we first set up the llm such that it could play text adventures , we noted that none of the models we tried to use with it were any good at it. We dreamed of a way to compare them, but all I could think of was setting a goal far into the game and seeing how long it takes them to get there. I just realised there’s…
It took me a few minutes to create a fake me giving a fake lecture.
A deep dive into evolutionary algorithms through the lens of low-poly image generation. This exploration covers genetic algorithm theory, custom Ruby implementation using the Petri Dish framework, and detailed analysis of genetic operators including roulette wheel selection, random midpoint crossover, and nudge…