By Lennart Finke.
Visit fi-le.net → RSS feedOn Hacker News Mar 2025 – Nov 2025
Software Engineering 2AI & Machine Learning 2Society, Policy & Culture 1History & Retro Computing 1Games & Graphics 1Databases & Data 1
OpenAI recently released their open-weights model. Here we'll discuss how that inevitably leaks some information about their model training stack, and, on the way, show that GPT-5 was trained on phrases from adult websites....
Divide a company's income by its revenue, and you get the operating margin. For some volume of sales that comes into the business, it gives an idea of what percentage is left as cash in the end. Barring some accounting shenanigans regarding where the bottom line is....
Baba is You is a sokoban puzzle game where the rules themselves have to be manipulated to win. (For the uninitiated, the store page should explain the idea best.) The level of abstraction required to solve most levels makes it a formidable reasoning benchmark, with many reasoning steps being completely orthogonal to…
PyPi, the Python Software Foundation's package repo, counts over half a million open source projects. Since I use many of these every day, it seemed appropriate to get to know this set of packages better, and show some appreciation. The index website provides nice search and filtering, which is good when looking for…
A Caesar cipher is a reasonable transformation for a transformer to learn in its weights, given that a specific cipher offset occurs often enough in its training data. There will be some hidden representation of the input tokens' spelling, and this representation could be used to shift letters onto other letters in…
Hermann Ludwig Heinrich Count of Pückler-Muskau was born in 1785 to the Earl Pückler and was later granted sovereignty over his land by King Friedrich III. His fame is unbroken today, but not because of his political power, but because his house chef named a dessert after him. In German and Dutch, the now popular…