New
The latest blog posts to take off on Hacker News. 4,224 posts.
Introducing WAL-G: Faster Disaster Recovery for Postgres
A key part of running a reliable database as a service is ensuring you have a good plan for disaster recovery. This post introduces WAL-G, the successor to WAL-E for Postgres, a complete rewrite of WAL-E that provides the same functionality plus 4x faster restores on recovery.
How Postgres Makes Transactions Atomic
A dive into the mechanics that allow Postgres to provide strong atomic guarantees despite the chaotic entropy of production.
Migrating 1200 databases from MySQL to Postgres
Once Upon a Time there was a company called Base7Booking that by the beginning of 2016 it was supporting around 1200 databases on MySQL 5...
The HDFS Juggernaut
There's been much focus on MongoDB, Elastic and Redis in terms of data exposure on the Internet due to their general popularity in the developer community. However, in terms of data volume it turns out that HDFS is the real juggernaut. To give you a better idea here's a quick
Plans for partitioning in PostgreSQL v11
The reaction to the new table partitioning feature in PostgreSQL 10 has been overwhelmingly positive, but a number of people have already as...
Macie: Automatically Discover, Classify, and Secure Content at Scale
This blog is out of date. Please refer here for the updated info. When Jeff and I heard about this service, we both were curious on the meaning of the name Macie. Of course, Jeff being a great researcher looked up the name Macie and found that the name Macie has two meanings. It has […]
Implementing Backup
How we implemented consistent, distributed, incremental backup in CockroachDB.
Principles of Sharding for Relational Databases
Some say sharding is the best way to scale a database. Sharding enables you to linearly scale cpu, memory, and disk by separating your database into smaller parts. Yet, sharding is controversial. This post explores the principles of sharding relational databases for B2B, B2C, and B2B2C applications.
Cargo cult data science
Data science as a cargo cult
Practical Guide to SQL Transaction Isolation
You may have seen isolation levels in the documentation for your database, felt mildly uneasy, and went on with life. Few day-to-day examples of using transactions really mention isolation. Most use the database’s default isolation level and hope for the best. It’s a fundamental topic to understand however and you’ll…
Implementing State Machines in PostgreSQL
Finite-state machine (FSM) is a wonderful model of computation that has many practical applications. One of my favorites is turning business logic into simple FSMs. For example consider the following requirements for an order management system:
1.1B taxi rides benchmark on the GPU- and PostgreSQL-powered BrytlytDB
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
A Comparison of Distributed Machine Learning Platforms
This paper surveys the design approaches used in distributed machine learning (ML) platforms and proposes future research directions. This ...
Pev: Postgres ‘Explain’ Visualizer (2016)
Postgres Explain Visualizer (Pev) is a tool I wrote to make EXPLAIN output easier to grok. It creates a graphical representation of the query plan.
What's so hard about histograms?
An interactive essay on the joys and pitfalls of histograms
ArangoDB 3.2 GA RocksDB, Pregel, Fault-Tolerant Foxx and Satellite Collections
The only enterprise AI data platform that cuts complexity, reduces costs, and gets you to production faster.
What Does It Take to Track a Million Cell Phones?
You can find anything and everything on the internet, yet nothing that explains how to track cell phones. Let us clarify right away, we are not talking about how to track your own cell phone in cas…