Building and operating a pretty big storage system called S3
Three distinct perspectives on scale that come along with building and operating a storage system the size of S3.
Werner Vogels on building scalable and robust distributed systems
Visit allthingsdistributed.com → RSS feedOn Hacker News Dec 2007 – Apr 2026
Systems & Performance 13Infrastructure & DevOps 12Databases & Data 9Tech Industry & Business 5Web & Frontend 1History & Retro Computing 1
Three distinct perspectives on scale that come along with building and operating a storage system the size of S3.
Marc Olson, a long-time Amazonian, discusses the evolution of EBS, highlighting hard-won lessons in queueing theory, the importance of comprehensive instrumentation, and the value of incrementalism versus radical changes. It's an insightful look at how one of AWS’s foundational services has evolved to meet the needs…
Andy Warfield writes about the hard-won lessons dealing with data friction that lead to S3 Files
Today is a very exciting day as we release Amazon DynamoDB, a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. DynamoDB is the result of 15 years of learning in the areas of large scale non-relational databases and cloud services. Several years ago we published…
It is time to celebrate EC2-Classic, which defined early cloud computing, and which is finally retiring.
Building evolvable software systems is a strategy, not a religion. And revisiting your architectures with an open mind is a must.
Today, I am publishing the Distributed Computing Manifesto, a canonical document from the early days of Amazon that transformed the architecture of Amazon's ecommerce platform. It highlights the challenges we were facing at the end of the 20th century, and hints at where we were headed.
In the first half of 2020 we plan to launch an AWS Region in South Africa
From simple object storage to sophisticated table management, builders have always shaped S3's evolution. Andy Warfield discusses why making complex systems simple remains our north star at AWS.
Today we announce our plans to open a new AWS Region with 3 Availability Zones in France! The new region in France will be ready for customers to use in 2017.
On March 14, 2016 it has been 10 years since the launch of Amazon S3, the first AWS service. Here are some lessons learned in those 10 years
Today Amazon Web Services takes another step on the continuous innovation path by announcing a new Amazon EC2 instance type: The Cluster GPU Instance. Based on the Cluster Compute instance type, the Cluster GPU instance adds two NVIDIA Telsa M2050 GPUs offering GPU-based computational power of over one TeraFLOPS per…
Adrian Cockcroft will be joining AWS as VP of Cloud Architecture
In this post I explore the Amazon ECS architecture and what this architecture enables.
AWS Senior Principal Engineers, Niko Matsakis and Marc Bowes, take us inside Aurora DSQL's development: scaling write operations without two-phase commit, overcoming garbage collection hurdles, and embracing Rust for both data and control planes.
A deep dive on why we changed Amazon S3's consistency model
The days of the one-size-fits-all monolithic database are behind us, and developers are using a multitude of purpose-built databases.
Today marks the 10-year anniversary of Amazon's Dynamo. Here are some reflections on ten years of NoSQL databases
In two weeks we’ll present a paper on the Dynamo technology at SOSP, the prestigious biannual Operating Systems conference. Dynamo is internal technology developed at Amazon to address the need for an incrementally scalable, highly-available key-value storage system. The technology is designed to give its users the…