1201
On Disk IO, Part 3: LSM Trees
If you like the series, check out my book on Database Internals!
New
The latest blog posts to take off on Hacker News. 1,888 posts.
1202
PostgreSQL's Hash Indexes Are Now Cool
Since I just committed the last pending patch to improve hash indexes to PostgreSQL 11, and since most of the improvements to hash indexes w...
1203
When Citi Bikes Are Faster Than Taxis in New York City
Over 50% of peak hour taxi trips would be faster as Citi Bike rides, and taxis are only getting slower
1204
Apache Arrow and the “Things I Hate About Pandas”
This post is the first of many to come on Apache Arrow, pandas, pandas2, and the general trajectory of my work in recent times and into the foreseeable future. This is a bit of a read and overall fairly technical, but if interested I encourage you to take the time to work through it.
1205
APFS – A Backup Software Developer’s Perspective
A backup-software developer's deep dive into Apple's APFS file system — snapshots, cloning, space sharing, and what it all means for reliable Mac backups.
1206
Transactionally Staged Job Drains in Postgres
Building a robust background worker system that leverages transactional isolation to never work a job too early, and transactional durability to never let one drop.
1207
Index Investing Makes Markets and Economies More Efficient (2016)
U.S. equity index funds have grown dramatically in recent decades, from a negligible $500MM in assets in the early 1980s to a staggering $4T today. The consensus view in the investment community is that this growth is unsustainable. Indexing, after all, is a form of free-riding, and a market can only support so many…
1208
Migrating from RethinkDB to Postgres – An Experience Report
Note: This post and our new engineering blog can be found at lumi.dev
1209
Most Female and Male Occupations Since 1950
The shifting majorities of the sexes in the workplace.
1210
Better Database Migrations in Postgres
As your database grows and scales there are some operations that you need to take more care of than you did when you were just starting. When working with your application in your dev environment you may not be fully aware of the cost of some operations until you run them against production. And at some point most of…
1211
House Address “Twins” Proximity
In a previous post, I did a bit of analysis of the names of towns and streets . However, that clearly wasn’t enough to sate my bizarre interest in all things address-based, so here I am again with more street-name-based nerdery.
1212
1213
1214
Tesla Model S battery degradation data
Want to read about the acceleration we are seeing in our society in the area of mobility? Read our new book ‘Forward’. Updated June 9, 2020. Today, Tesla Motors published their 2019 Imp…
1215
Restic Cryptography
tl;dr: this is not an audit and I take no responsibility for your backups, but I had a quick look at the crypto and I think I’m going to use restic for my personal backups.
1216
The Marketing Behind MongoDB
Countless NoSQL databases competed to be the database of choice. MongoDB's marketing strategy helped it become the winner.
1217
Analyzing Cryptocurrency Markets Using Python
A data-driven approach to cryptocurrency (Bitcoin, Ethereum, Litecoin, Ripple etc.) market analysis and visualization using Python.
1218
1219
How Postgres Makes Transactions Atomic
A dive into the mechanics that allow Postgres to provide strong atomic guarantees despite the chaotic entropy of production.
1220
Migrating 1200 databases from MySQL to Postgres
Once Upon a Time there was a company called Base7Booking that by the beginning of 2016 it was supporting around 1200 databases on MySQL 5...
1221
Plans for partitioning in PostgreSQL v11
The reaction to the new table partitioning feature in PostgreSQL 10 has been overwhelmingly positive, but a number of people have already as...
1222
1223
1224
Cargo cult data science
Data science as a cargo cult
1225
1226
Practical Guide to SQL Transaction Isolation
You may have seen isolation levels in the documentation for your database, felt mildly uneasy, and went on with life. Few day-to-day examples of using transactions really mention isolation. Most use the database’s default isolation level and hope for the best. It’s a fundamental topic to understand however and you’ll…
1227
Implementing State Machines in PostgreSQL
Finite-state machine (FSM) is a wonderful model of computation that has many practical applications. One of my favorites is turning business logic into simple FSMs. For example consider the following requirements for an order management system:
1228
1.1B taxi rides benchmark on the GPU- and PostgreSQL-powered BrytlytDB
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
1229
A Comparison of Distributed Machine Learning Platforms
This paper surveys the design approaches used in distributed machine learning (ML) platforms and proposes future research directions. This ...
1230