Hetzner is working on LLM Inference
Hetzner has launched an experimental LLM inference API. I tested its Qwen model—and have a few guesses about where the product could go next.
Hetzner has launched an experimental LLM inference API. I tested its Qwen model—and have a few guesses about where the product could go next.
Notable organizations disclosed ~1,300 high- and critical-severity CVEs in June 2026, roughly 3.5× the pre-Mythos monthly record. Epoch AI's breakdown of vulnerability disclosures following Anthropic's Project Glasswing.
Somehow, Palpatine returned.
Training my watch to track intelligence
Today we launched a new plugin for Datasette, datasette-apps, with this launch announcement post on the Datasette project blog. That post has the what, but I’m going to expand on …
Exploring the Date::ITALY Ruby constant, Julian day numbers, and the history of the Gregorian calendar switchover.
From the Zed Blog: Ted Nelson specified the docuverse sixty years ago. The technology finally arrived, and so did its native users.
We are told that wealth is a measure of contribution. The richer a person becomes, the more they must have given to society. This is one of the founding myths of capitalism. It is repeated so often…
Not doing the reading.
Updates to the Gemini API File Search tool makes building efficient, multimodal file retrieval systems easier for developers.
ReactOS is a free, opensource reimplementation of windows
Many people know, or have heard of, the Motorola 68000 architecture. These processors have been used in many machines: in the first generations of Apple Macintosh computers, in the ever-rivals Amiga and Atari ST home computers, in many workstations built by Sun , HP and NeXT (to name only a few), but also in many…
Open AI models used for a wide range of scientific applications, including accelerating the design of therapeutic molecules.
We set out to build the first AI tutor to teach math and reading to kids ages 4-9. For AI to actually teach a five-year-old, pedagogy must be baked into the engineering. A child can't wait for a slow reply, can't read a chat interface, and can't unhear anything a model gets wrong. We wanted to share some of the…
I have been a director of engineering for a bit over three years now, and I still hear and read what I call the "old rules" repeated over and over: a director should not spend time coding, good work takes time, protect the team from the business, get consensus before
A blog about computers, functional languages, Lisp, and Scheme.
Upgrade your RTX 2080 Ti from 11GB to 22GB worldwide. Professional VRAM replacement, BIOS tuning & testing by GPU Solutions.
Solving the conflicting subnet problem with overlay addressing, WireGuard, and 1:1 NAT.
Just because you haven’t moved from the sofa doesn’t mean you’re dead.
It's not my favorite language
The planet next door may be rough, but it has a lot of atmosphere
The University of Granada participates in research linking a bacterium of the Roseburia genus with improved physical condition. This finding could lead to a probiotic for human consumption that helps maintain strength and fitness during aging. The study has been published in the prestigious scientific journal Gut
This is a memo I published internally to my team at Monarch. I’m sharing it more publicly in case it helps other software engineering teams that are managing the crazy times we’re exper…
(this post figured on HNews here) This happened to me in 2020, and it has been on my mind again lately. During the worst of the pandemic, I found a vulnerability in a system that gave me access to the Brazilian federal system, and with that access I was able to retrieve information on any
After the success of using agents to improve query performance through autoresearch , I wanted to try something more ambitious. I rewrote PostHog's…
When code execution really is all you need. Exploring what happens when an AI agent can only write and run code.
Code, Apps and Thoughts @lawrencegripper
RAG poisoning attack walkthrough: an attacker injects fabricated documents into a ChromaDB knowledge base and the LLM reports false financials as fact. Fully reproducible, 100% local, no GPU required.
Lossless compression of a target model's KV cache by up to 4×, using a cheaper predictor model to drive an arithmetic coder.
Inference techniques either move a deployment along the latency–throughput frontier or push the entire frontier out, creating more efficiency to allocate.