How Is LLaMa.cpp Possible?
If you want to read more of my writing, I have a Substack . Articles will be posted simultaneously to both places.
Topics /
The most popular blog posts about ai & machine learning on Hacker News. 3,090 posts.
If you want to read more of my writing, I have a Substack . Articles will be posted simultaneously to both places.
The delirious rantings of Frederick Vanbrabant. A blog focused on the intersection of Enterprise Architecture, product, and business strategy.
Chinese AI lab DeepSeek’s last model release was V3.2 (and V3.2 Speciale) last December. They just dropped the first of their hotly anticipated V4 series in the shape of two …
Vector embeddings have been an Overton window shifting experience for me, not because they’re sufficiently advanced technology indistinguishable from magic, but the opposite.
If you liked this piece, you should subscribe to my premium newsletter. It’s $70 a year, or $7 a month, and in return you get a weekly newsletter that’s usually anywhere from 5,000 to 18,000 words, including vast, detailed analyses of NVIDIA, Anthropic and OpenAI’s
How I tricked Claude into leaking your deepest, darkest secrets
This is the text version of a talk I gave on November 11, 2016, at the Direction conference in Sydney.
I trained a small transformer from scratch in 1.5hrs on a 5090 Beats many LLMs, and scores the same as TRM/HRM
Every layer is a memory store
Embeddings are a really neat trick that often come wrapped in a pile of intimidating jargon. If you can make it through that jargon, they unlock powerful and exciting techniques …
Questioning the frame of inevitability in use of AI
In this post, we walk through my entire workflow/process for bringing Stable Diffusion to life as a high-quality framed art print. We’ll touch on making art with Dreambooth, Stable Diffusion, Outpainting, Inpainting, Upscaling, preparing for print with Photoshop, and finally printing on fine-art paper with an Epson…
Imagine an innovation in pipes.
A lot has been written about the incidents of the last few months in which AI agents misbehaved in serious ways. They took actions that would be considered as crimes if a human took them, escaped their containment to cheat on assigned tasks while attempting to evade detection, and coordinated toward goals nobody had…
All the reasons why Nvidia will have a very hard time living up to the currently lofty expectations of the market.
I feel like vibe coding is pretty well established now as covering the fast, loose and irresponsible way of building software with AI—entirely prompt-driven, and with no attention paid to …
A 360M model that pretends to be a terminal, and remembers what you did
Together with some friends, I decided earlier this year to particpate in the Carbage run 2025 Winter edition. This is a 6-day journey in winter all the way through Sweden to the polar circle, and back down to Helsinki in a group of roughly 400 cars. One small catch (you might have guessed it from the name): your car…
A field guide and why we need to rethink our expectations
Ollama gained traction by being the first easy llama.cpp wrapper, then spent years dodging attribution, misleading users, and pivoting to cloud, all while riding VC money earned on someone else's engine. Here's the full history, and why the alternatives are better.
I procrastinated a deep dive into transformers for a few years. Finally the discomfort of not knowing what makes them tick grew too great for me. Here is that dive.
I’ve had preview access to the new GPT-5 model family for the past two weeks (see related video and my disclosures) and have been using GPT-5 as my daily-driver. It’s …
I’m a huge fan of Claude’s Artifacts feature, which lets you prompt Claude to create an interactive Single Page App (using HTML, CSS and JavaScript) and then view the result …
I’ve been running Kimi K3 alongside Claude on my normal coding work, and for all practical purposes I can’t tell them apart. Same tasks, same quality of outp...
The key advantage may not be superior reasoning, but a virtually unlimited symbolic working memory.
AGI is a harmful and wasteful fantasy that runs counter to the principles of efficient and effective engineering.
Including OpenAI’s other text generating AI!
Kevin Hughes' blog
Over the last several months, the two leading frontier AI labs have shown some brazen behavior. It started with a series of carefully planned announcements ... Read more