Monarch: Google’s Planet-Scale In-Memory Time Series Database
These paper reviews can be delivered weekly to your inbox , or you can subscribe to the Atom feed . As always, feel free to reach out on Twitter with feedback or suggestions!
These paper reviews can be delivered weekly to your inbox , or you can subscribe to the Atom feed . As always, feel free to reach out on Twitter with feedback or suggestions!
Caches help reduce latency, scale read-heavy workloads, and save cost. They are literally everywhere. Caches run on your phone and in your browser. For example, CDNs and DNS are essentially geo-rep…
ClickHouse Cloud has entered public beta. Get your free trial now!
The 2022 Cloud Report is the only cloud performance report to compare AWS, Azure, and GCP on benchmarks that reflect critical applications and workloads.
We are members of the Facebook Notifications Data Science team at Meta. We ran surveys on how users felt about on-site notifications…
Once upon a time, I was on a small team tasked with building a data pipeline. On this team was someone we’ll call Bob, who was fresh out of grad school and hadn’t had much experience with software engineering, and no experience with SQL. As part of this data pipeline, Bob had to combine the data from two tables. JOIN…
Who's the customer, anyway?
In 2022, data engineers manage forests, not trees
The database. The app. The legend.
At Spacelift, we use PostgreSQL (specifically Aurora Serverless) for most of our primary database needs. This article will show you our optimization story and how PostgreSQL row count estimation can go very wrong.
Under unsupervised learning, all the objects in the same group (cluster) should be more similar to each other than to those in other clusters; data points from different clusters should be as different as possible. Clustering allows you to find and organize data into groups that have been formed organically, rather…
MySQL UUIDs are still very popular despite a majority of posts warning against their usage. Learn what UUIDs are and why they are very bad for MySQL performance.
This week at USENIX ATC’22, a group of my colleagues 1 from the AWS DynamoDB team are going to be presenting their paper Amazon DynamoDB: A Scalable, Predictably Performant, and Fully Managed NoSQL Database Service . This paper is a rare look at a real-world distributed system that runs at massive scale.
At Nile, we’re making it easier for companies to build world-class control planes for their infra SaaS products
We have just launched Neon to provide you with the best Postgres experience in the cloud. You can sign up to our waitlist right now and experience serverless Postgres enabled by the separation of storage and compute. The service is still gated by the waitlist as we are onboarding more and more users every day, and we…
Amazon DynamoDB was introduced 10 years ago today; one of its key contributors reflects on its origins, and discusses the 'never-ending journey' to make DynamoDB more secure, more available and more performant.
I wanted to share the attached paper on choice prediction that I recently co-authored with Itamar Simonson in case it’s of interest.
Machine learning is a subfield of artificial intelligence (AI) and computer science that focuses on using data and algorithms to mimic the way people learn, progressively improving its accuracy. This way, Machine Learning is one of the most interesting methods in Computer Science these days, and it'
PostgreSQL query planner is full of surprises, so a common-sense approach to writing performant queries is sometimes misleading. In this blog post, I'll describe examples of optimizing seemingly obvious queries with the help of EXPLAIN ANALYZE and Postgres metadata analysis.
This is my journey of creating a proof-of-concept of persisting an SQLite database in a Cloudflare Durable Object. It is not meant as a tutorial, but rather as something I myself can get back to it, to revisit what and why I did certain things.
Explore SQLite Internals: How The World's Most Used Database Works by Abdur-Rahmaan Janhangeer. Deep dive into database internals, systems engineering, and advanced Python.
tl;dr: I believe HN Who is Hiring? posts are down; scroll to the bottom for the chart, code lives here. Hacker News. The Orange Site. Since April 2011, it’s had a thread every month, which dares potential employers to answer one question: who is hiring? I take a quick skim through this thread every month. ... Hacker…
Understanding how the write-ahead log turns your scaling up to 11.
Grafana Labs is helping enable continuous profiling at cloud native scale for the open source community and enterprises, giving developers a better understanding of resource usage of their code.
I’m pleased to announce that Part II of the “ PostgreSQL 14 Internals ” book is available now. This part explores the purpose and design of the buffer cache and explains the need for write-ahead logging. Please download the book freely in PDF. There are three more parts to come, so stay tuned! Thanks to Matthew Daniel…