The real failure rate of EBS
Our experience running AWS EBS at scale for critical workloads
The latest blog posts to take off on Hacker News. 6,945 posts.
Our experience running AWS EBS at scale for critical workloads
Published: 17-03-2025 20:33 | Author: Remy van Elst | Text only version of this article
I gave a talk at the Berkeley I-school's Information Access Seminar entitled Archival Storage . Below the fold is the text of the talk with...
We've released version 0.4.2 of zlib-rs , featuring a number of substantial performance improvements. We are now (to our knowledge) the fastest api-compatible zlib implementation for decompression, and beat the competition in the most important compression cases too.
Safely leverage PostgreSQL's asynchronous commit for significant performance gains
A war story of manually sharding Postgres across 6 databases under load, and the case for automating the process with a proxy instead of weeks of engineering effort.
The “Exo 2” language allows programmers to write “schedules” that explicitly control how the compiler generates code. This allows performance engineers to transform simple programs into complex programs that do the same thing as the specification, but faster.
From simple object storage to sophisticated table management, builders have always shaped S3's evolution. Andy Warfield discusses why making complex systems simple remains our north star at AWS.
TinyKVM can be used to sandbox regular Linux programs or programs with specialized APIs embedded into your servers.
Take an interactive journey through the history of IO devices, and learn how IO device latency affects performance.
Git's new bundle-uri could help significantly speed up clones, but what bugs lurk within?
The worst "street-cred" I have is that I've been using tiling window managers for thirty-five percent of my life: five years with Sway and two...
The developer resources in just one place!
To start off, we can leverage the STL for this calculation. std::count_if() more precisely:
Musings on the representation, propagation and handling of errors in existing programming languages, as well as thoughts on future systems. (15K+ words)
We introduce Polars Cloud, the distributed cloud architecture to scale and run Polars anywhere.
We’re sharing details about Strobelight, Meta’s profiling orchestrator. Strobelight combines several technologies, many open source, into a single service that helps engineers at Meta improve effic…
Learn how Linux/FFmpeg C partial codebase is organized to be extensible and act as if it were meant to have “polymorphism”. Specifically, we’re going to briefly explore how Linux …
Databricks offers a unified platform for data, analytics and AI. Build better AI with a data-centric approach. Simplify ETL, data warehousing, governance and AI on the Data + AI Platform.
Hard as it may be to imagine, there was a time when Java was brand new and exciting. Long before it became the vast clunky back-end leviathan it is today, it was going to be the ubiquitous graphical platform that would be used on everything from cell phones to supercomputers: write once, run anywhere. Initially …
During the winter of 2024, I restored an IBM PS/1 486-DX2 66Mhz, "Mini-Tower", model 2168. It was the computer I always wanted as a teenager but could never afford. Words cannot do justice to the joy I felt while working on this machine.
Learn why SQLite-on-the-server fits hyper-scale systems when each tenant gets an isolated database with local reads, durable storage, and simple…
This week-end project started by browsing the open-data repository of Paris’ public transport network, which contains various APIs to query real-time departures, current disruptions, etc.The data reuse section caught my eye, as it features external projects that use this open data.In particular, the RATP status…
VectorChord-BM25 enhances PostgreSQL search with BM25 ranking, 3x faster than ElasticSearch. Supports BERT, Tocken, and Unicode tokenizers
A concise breakdown of what smallpond and 3FS are, how to use them, and if they're suitable for your data processing needs.
Json parsing in C using function pointers attached to a struct
TLDR; Starting from Linux kernel version 6.9 on x86_64, there’s a new config option CONFIG_X86_FRED enabled and it adds 16 bytes to the starting point of a task’s kernel stack area, so you’ll need to account for this extra padding in your “raw” kernel stack & pt_regs lookup code. Update: It turns out that there’s a…
A while back my machine was so messed up that I could barely ssh onto it. 3,200% CPU utilization - all 32 cores on the host were fully utilized! Compare that to my last bug where it only used 1 core, 100% Fortunately, it was using Java 17 runtime which...