Erasure Coding for Distributed Systems
An overview of erasure coding, its trade-offs, and applications in distributed storage systems.
The latest blog posts to take off on Hacker News. 5,273 posts.
An overview of erasure coding, its trade-offs, and applications in distributed storage systems.
On June 26, 1826, John James Audubon sat aboard the cotton schooner Delos off of Florida’s Gulf coast, en route from New Orleans to Liverpool, where he was hoping to find a publisher for his extensive portfolio of paintings of American birds.[1] On this particular day, the winds were still, leaving Audubon’s boat to…
Like Heroku, but you own it.
In distributed systems, for instance when scaling out some workload to multiple compute nodes, it is a common requirement to select a leader for performing a given task: only one of the nodes should …
View this post in browser Your pie doesn't need to be original (unless you claim it so) Imagine you bake a delicious peach pie over the weekend, and you...
An increasing number of self-hostable software meets a tool to make self-hosting trivial.
A rundown of my experience finding and fixing a bug in the Chromium/Google Chrome browser - specifically in the devtools. It includes details about the bug itself as well as notes about what it was like working on the Chromium project as a first-time contributor.
Pournelle's Iron Law of Bureaucracy states that in any bureaucratic organization there will be two kinds of people":
Met deze test controleren we of u een mens bent. Hiermee voorkomen we ongeoorloofd gebruik van deze dienst.
You know the nagging feeling that your product, project, or company has become more complicated than it needs to be? You can solve many problems and get better results by doing something unthinkable to many: removing parts that once seemed essential. My crusade against complexity continues with this short story
My post on how I like to manage servers. I cover SSH, networking, log rotation, and server management basics.
Cinder is part of a growing list of US-based tech companies that encounter engineering applicants who are actually suspected North Korean nationals. Here's what we're doing about it.
To bootstrap Rust, no cost is too great.
Teardown and analysis of electronics. Integrated circuit design analysis.
Lessons Learned: Sharding for startups is a technical post about database scalability. What caught my eye was the term . What an odd term — “sharding.” Why would a database be described that way?
This blog is reserved for more serious things, and ordinarily I wouldn’t spend time on questions like the above. But much as I’d like to spend my time writing about exciting topics, som…
About a month ago [1] , I was onboarding a friend into one of my side project codebases and she asked me why I was using a particular type of UUID. I'd heard about this type while working on that project, and it's really neat. So instead of hogging that knowledge for just us, here it is: some good uses for different…
Errata: Some significant mistakes were pointed out to me by email by Brendan MacDonell. I have included errata, but the results might not be reliable, so take this with pinch of salt! vmsplice is too fast Some programs use a particular system call “vmsplice” to move data faster through a pipe. Francesco already did a…
Lidl is launching sovereign cloud computing in Europe. GDPR and data compliance is driving the EU to look for local alternatives.
UPDATE 2/20/2006: After about a month, the project is now finished. You can go through the series and read my explanations for each step, or you can just page through and gander at the pretty pictures. If you’re the impatient sort, you could just jump to part 10 right now and see how it turned out.
Exporting graph data to text file and SVG with Datalog
Lineage OS is based on the Android Open-Source Project, whose primary maintainer is Google. To what extent can it be considered Google-free?
I’ve long been enamored of the sparkline, a graphical device which its inventor Edward Tufte defines thusly: A sparkline is a small intense, simple, word-sized graphic with typographic resolu…
The Convivial Society: Vol. 5, No. 11
A new paper from Google Research describing custom syntax for analytical SQL queries that has been rolling out inside Google since February, reaching 1,600 "seven-day-active users" by August 2024. A …
Generate calendar entries from an image using Anthropic Claude 3.5. Convert lesson dates in an image to a calendar ICS file
Build a retrieval system with semantic, full-text, and fuzzy search in Postgres to be used as a backbone in RAG pipelines.
As part of our zoom reading group ( wow, 4.5 years old now ), we discussed a paper that uses LLMs for automatic root cause analysis (RCA) fo...