Building and operating a pretty big storage system called S3
Three distinct perspectives on scale that come along with building and operating a storage system the size of S3.
Werner Vogels on building scalable and robust distributed systems
Visit allthingsdistributed.com → RSS feedOn Hacker News Dec 2007 – Apr 2026
Systems & Performance 13Infrastructure & DevOps 12Databases & Data 9Tech Industry & Business 5Web & Frontend 1History & Retro Computing 1
Three distinct perspectives on scale that come along with building and operating a storage system the size of S3.
Marc Olson, a long-time Amazonian, discusses the evolution of EBS, highlighting hard-won lessons in queueing theory, the importance of comprehensive instrumentation, and the value of incrementalism versus radical changes. It's an insightful look at how one of AWS’s foundational services has evolved to meet the needs…
Andy Warfield writes about the hard-won lessons dealing with data friction that lead to S3 Files
It is time to celebrate EC2-Classic, which defined early cloud computing, and which is finally retiring.
Building evolvable software systems is a strategy, not a religion. And revisiting your architectures with an open mind is a must.
Today, I am publishing the Distributed Computing Manifesto, a canonical document from the early days of Amazon that transformed the architecture of Amazon's ecommerce platform. It highlights the challenges we were facing at the end of the 20th century, and hints at where we were headed.
From simple object storage to sophisticated table management, builders have always shaped S3's evolution. Andy Warfield discusses why making complex systems simple remains our north star at AWS.
In this post I explore the Amazon ECS architecture and what this architecture enables.
AWS Senior Principal Engineers, Niko Matsakis and Marc Bowes, take us inside Aurora DSQL's development: scaling write operations without two-phase commit, overcoming garbage collection hurdles, and embracing Rust for both data and control planes.
A deep dive on why we changed Amazon S3's consistency model
Today marks the 10-year anniversary of Amazon's Dynamo. Here are some reflections on ten years of NoSQL databases
In two weeks we’ll present a paper on the Dynamo technology at SOSP, the prestigious biannual Operating Systems conference. Dynamo is internal technology developed at Amazon to address the need for an incrementally scalable, highly-available key-value storage system. The technology is designed to give its users the…