Every blog post that took off on Hacker News, ranked by the votes of its best submission. 3,091 posts.
Large language models (LLMs) like the GPT family learn the statistical structure of language by optimising their ability to predict missing words in sentences (as in ‘The cat sat on the [BLANK]’). Despite the impressive technical ju-jitsu of transformer models and the billions of parameters they learn, it’s still a…
A field guide to responsible AI-assisted development
One of my favorite AI dev products today is Full Line Code Completion in PyCharm (bundled with the IDE since late 2023). It’s extremely well-thought out,...
I have previously blogged about the relatively new trend of AI slop in vulnerability reports submitted to curl and how it hurts and exhausts us. This trend does not seem to slow down. On the contrary, it seems that we have recently not only received more AI slop but also more human slop. The latter … Continue reading…
Wolfram expands Notebooks, integrating LLM functionality into the new chat cell and Chat Notebook. Stephen Wolfram explains how chat-enabled and chat-driven versions work.
The amount of time my outdoor cameras are being set off by light, wind, cars, or anything other than a human is insane. Overly cautious security cameras might be a feature, but an annoying one at that...
Using CPUs instead of GPUs for deep learning training in the cloud is cheaper because of the massive cost differential afforded by preemptible instances.
This post does a deep dive on the **epic goal celebration hack**. In a single sentence, I trained a machine learning model to detect in real-time that a goal was just scored by the Habs based on the live audio feed of a game and to trigger a light show using Philips hues in my living room.
In the previous two golden ages (1950s-1960s and the 1980s), our expectations outpaced the capabilities of the technology at the time, leading to disappointment. In contrast, the AI technology of the current golden age, which began in the mid-2010s, has consistently exceeded our expectations.
OpenAI and Nvidia are both under threat from Google; I like OpenAI’s chances best, but they need an advertising model to beat Google as an Aggregator.
Anthropic faces a Friday deadline to allow domestic surveillance and automated killer robots.
Giving University Exams in the Age of Chatbots par Ploum - Lionel Dricot.
I gave Claude Fable 5 and GPT-5.6 Sol the same unpublished NP-hard optimization problem, with and without their native /goal mode. Fable 5 is a beast; /goal is not a game changer.
Let’s hack the world’s most popular Wordpress CAPTCHA Plug-in
Answering questions and concerns.
Maps Mania is a blog dedicated to tracking the very best digital interactive maps on the internet and the tools used to create them.
A deep-dive into machine learning embeddings.
Before diving inFor a long time, I recall having this vague impression about Gaussian Processes (GPs) being able to magically define probability distributions over sets of functions, yet I procrastinated reading up about them for many many moons. However, as always, I’d like to think that this is not just due to my…
Pure scaling in shambles
Today Raspberry Pi launched their new $130 AI HAT+ 2 which includes a Hailo 10H and 8 GB of LPDDR4X RAM. With that, the Hailo 10H is capable of running LLMs entirely standalone, freeing the Pi's CPU and system RAM for other tasks. The chip runs at a maximum of 3W, with 40 TOPS of INT8 NPU inference performance in…
its computational convenience • connections to the Gaussian distribution • differentiability and basis independence • why not squared error • absolute-error methods
Some (well-known) consequences of AI automating work
And a plea to think seriously about climate change without getting distracted
I read this post “Our strategy is to combine AI and Algorithms to rewrite Microsoft’s largest codebases [from C++ to Rust]. Our North Star is ‘1 engineer, 1 month, 1 million lines of code.” and it got me curious, how difficult is it really?
How the Elixir community can survive — and thrive — in an age of LLMs.
In the past months, Tesla has been offering a free, one-month trial of their full self-driving (FSD) system to all current owners. It looks like they are rolling this out in stages, because I only got mine only a few days ago.
AI and the ruliad in the Wolfram Physics Project provide a new way to consider how alien minds might perceive the world. Stephen Wolfram explains how this artificial neuroscience experiment works.
I know it’s a weird way to start a blog with a negative, but there was a wave of discussion in the last few days that I think serves as a good hook for some topics on which I’ve been thinking recently. It all started with a post in the Simply Stats blog by Jeff Leek on the caveats of using deep learning in the small…
Many new Transformer architecture improvements have been proposed since my last post on “The Transformer Family” about three years ago. Here I did a big refactoring and enrichment of that 2020 post — restructure the hierarchy of sections and improve many sections with more recent papers. Version 2.0 is a superset of…
How I (almost) replicated OpenAI’s GPT-2 (124M version)
