Task-specific LLM evals that do and don't work
Evals for classification, summarization, translation, copyright regurgitation, and toxicity.
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 49,247 posts.
Evals for classification, summarization, translation, copyright regurgitation, and toxicity.
A common analogy for explaining gradient descent goes like the following: a person is stuck in the mountains during heavy fog, and must navigate their way down. The natural way they will approac......
What was once a pre-market morning newsletter became an afternoon newsletter, 12 seconds at a time
Over on Google+, a computer scientist at McGill named Artem Kaznatcheev passed on this great description of what it’s like to learn math, written by someone who calls himself ‘man aft…
Building resilient services by identifying foreign state mutations and grouping local changes into restartable atomic phases so that every request can be driven to completion.
A progress update on where my Rye Project is today.
On February 18, 2025, Humane announced it would be shutting down all services for the always online Humane Ai Pin in ten days, following a sale to HP . I had been vaguely aware of the Ai Pin, definitely more so than the average tech person, as I have a close friend who was one of the earliest adopters and eventually…
Posts from the old antjanus.com blog (2012–2020), rebuilt from the Wayback Machine.
I get asked two questions several times a week, and I brush off both with a verbal swat. One — because I’m in my late 20s, I suppose – is when are you getting married? And the other, because …
Stephen Wolfram describes his friendship and shared interest in computation with the late Marvin Minsky, pioneer of computation and AI.
Professional niches have – time immemorial – built their own special dialects and languages, sometimes using this as an…
The most controversial and confronting of the many categories of Afghan “war carpets” made since the Soviet invasion in 1979 were those which first appeared in early 2002 and which memorialized the…
CUDA grep : Manish and Brandon's 15418 final project
My current generative artwork-in-progress includes text, but I don’t want to use a font. In browser based art work, using a “web safe” font could produce inconsistent results, while including a font file would mean a large file size. Additionally, I don’t want a visual element of the project to be s
urandom talks
Traditionally, mathematics research projects are conducted by a small number (typically one to five) of expert mathematicians, each of which are familiar enough with all aspects of the project that…
I show how I built a mini startup called Hoodmaps in public from the first line of code to a functioning web app that I got to the frontpage of Reddit with ove…
Gosper's Glider Gun in Conway's Game of Life I'd known of Conway since my early teens. I remember reading about his Game of Life in an old Scientific American someone gave me. The article (a quick search tells me) was published in October 1970, so I'm guessing I saw it in the early 70s, perhaps 1972. I was hooked.
A few weeks ago I criticized a proposal by Antirez for a hypothetical linearizable system built on top of Redis WAIT and a strong coordinator. I showed that the coordinator he suggested was physically impossible to build, and that anybody who tried to actually implement that design would run into serious problems. I…
I’ve been exploring the idea of an Elm compiler that produces assembly for the Erlang Virtual Machine. You can find the code for this project on GitHub . This essay documents some interesting parts of the project.
A quick overview of the various types of signal intelligence targets, with an emphasis on the Soviet Cold War systems
Last week I jokingly said that POPL papers must pass an ‘intellectual intimidation’ threshold in order to be accepted. That’s not true of course, but it is the case that programming languages paper…
When Delta started testing 'Basic Economy' fares in 2012 the idea was to compete with the ultra low cost carriers -- they already had to match price, so they wanted to be able to offer a product that was closer to the limited service Spirit provided, in hopes that customers would buy up to more expensive fares for…