A brief history of Dell Unix (2008)
[update December 2021: files for 86Box install at update December 2020: Dell Unix on 86Box “Today let me present Dell Unix more properly, with 1024×768, 256 colors video and proper networking…
[update December 2021: files for 86Box install at update December 2020: Dell Unix on 86Box “Today let me present Dell Unix more properly, with 1024×768, 256 colors video and proper networking…
This article provides a short introduction to the pipeline used to create the data to train large language models (LLMs) such as LLaMA using Common Crawl (CC).
What is Damas-Hindley-Milner?
When it comes to designing secure protocols, I have a principle that goes like this: if you have to perform any cryptographic operation before verifying the MAC on a message you’ve received, it will somehow inevitably lead to doom.
I summarise the kinds of evaluations that are needed for a structured data generation task.
It has been said that the most popular programming language in the world is the spreadsheet (and in particular these days, Excel). There...
"Science and The Way to Health" by Andress and Brown
Looking beyond the hype and explaining why microservices should nearly become extinct.
Recently one of my colleagues was reading Alan Turing’s groundbreaking 1936 article “On Computable Numbers with an Application to the Entscheidungsproblem.” This is the article in…
The Royal Society is a venerable institution founded in 1660, whose original members included such eminent men as Christopher Wren, Robert H...
I recently stumbled upon a blog post by Alejandra González (a.k.a @blyxyas) that seeks to compress a tic-tac-toe game state into as few bits as possible. She arrived at a solution in 18 bits. This got me thinking, can we do better?
Picture this: It’s ten years ago, and you’ve just launched a new WordPress blog. Within hours, sometimes even minutes, your content is indexed by Google. You search for a unique sentence from your…
Jacob Wenger's online garden
Behavioural economics, data science and artificial intelligence.
The basics condensed into one very large document
GC within a function doesn't work how I expected
I provide this HTML version of a historical article because it was not easily available but was central to my article: Reagle, J. (2010). “Be nice”: Wikipedia norms for supportive communication. New Review of Hypermedia and Multimedia (Special Issue on Web Science) , 16(1), 161–180…
Dozens of founders have used this technique to transform the cash-flow of their businesses. Now it's your turn.
I needed to log when a light switched on and off during the night as part of debugging an oddly behaving movement sensor. To do that I built...
This morning, I came accross Cameron Sun’s Probabilistic Tic-Tac-Toe on HN . However, the comments were disappointing, with people proposing probabilistic models, linear programming, minimax algorithms, and heuristic evaluations to develop AI approaches for the game, none of which quite correct. In this post, I’ll…
Programmable NVIDIA GPUs are very inspiring to hardware geeks, proving that processors with an original, incompatible programming model can become widely used.
Protein “language” is a lot like human language. Given the similarities, researchers have been building and training language models on protein sequence data, replicating the success seen in other domains, with profound implications. In this post, I will explore how transformer models have been applied to protein data…
Clojure macros have two modes: avoid them at all costs/do very basic stuff, or go absolutely crazy.
Luke Horton asked in a comment on a recent post: Given the chance to examine a titanosaur cadaver with your hypothetical army of anatomists, what would you look for first? *FACEPALM* How we’v…
Matthew Honnibal is a computational linguist from Sydney based in Berlin, Germany. He's the author of the spaCy Natural Language Processing library and the co-founder of Explosion.
Trust me, there's a reason for this