1
SQLite as an Application File Format (2014)
An SQLite database file with a defined schema often makes an excellent application file format. Here are a dozen reasons why this is so:
Most cited
Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 46 posts.
2
Command-line tools can be faster than a Hadoop cluster (2014)
Adam Drake is an advisor to scale-up tech companies. He writes about ML/AI/data, leadership, and building tech teams.
3
How to Corrupt a SQLite Database File
An SQLite database is highly resistant to corruption. If an application crash, or an operating-system crash, or even a power failure occurs in the middle of a transaction, the partially written transaction should be automatically rolled back the next time the database file is accessed. The recovery process is fully…
4
Jepsen: MongoDB 4.2.6
2020-05-26: MongoDB identified a bug in the transaction retry mechanism which they believe was responsible for the anomalies observed in this report; a patch is scheduled for 4.2.8.
5
CQRS: Command Query Responsibility Segregation (2011)
CQRS (Command Query Responsibility Segregation) is the notion that you can use a different model to update information than the model you use to read information
6
Peppering (Password Storage)
Website with the collection of all the cheat sheets of the project.
7
Scaling SQLite to 4M QPS on a Single Server (EC2 vs. Bare Metal)
Discover how Expensify achieved remarkable scaling: 4M QPS on one server! Dive into optimizing SQLite for impressive performance gains.
8
ZFS: Use mirror vdevs, not RAIDZ
Continuing this week’s “making an article so I don’t have to keep typing it” ZFS series… here’s why you should stop using RAIDZ, and start using mirror vdevs instead.
9
Sizing Up Twitter Users
Twitter users are younger, more likely to identify as Democrats, more highly educated and have higher incomes than U.S. adults overall.
10
Amazon S3 Update – Strong Read-After-Write Consistency
When we launched S3 back in 2006, I discussed its virtually unlimited capacity (“…easily store any number of blocks…”), the fact that it was designed to provide 99.99% availability, and that it offered durable storage, with data transparently stored in multiple locations. Since that launch, our customers have used S3…
11
CRDTs are the future
I saw Martin Kleppmann’s talk a few weeks ago about his approach to realtime editing with CRDTs, and I felt a deep sense of despair. Maybe all the work I’ve been doing for the past decade won’t be part of the future after all, because Martin’s
12
Scaling Datastores at Slack with Vitess
From the very beginning of Slack, MySQL was used as the storage engine for all our data. Slack operated MySQL servers in an active-active configuration. This is the story of how we changed our data storage architecture from the active-active clusters over to Vitess — a horizontal scaling system for MySQL. Vitess is…
13
Demonstrations and Political Violence in America: New Data for Summer 2020
The report covers 2020 trends in political violence and demonstrations in the US, focusing on the BLM movement.
14
US Federal Agricultural Farm Subsidies: How Much Farmers Get By Year
Federal farm subsidies make up an average of 13.5% of net farm income.
15
Target didn’t figure out a teen girl was pregnant before her father did
And that one article that said they did was silly and bad
16
SQLite Is Serverless
Most SQL database engines are implemented as a separate server process. Programs that want to access the database communicate with the server using some kind of interprocess communication (typically TCP/IP) to send requests to the server and to receive back results. SQLite does not work this way. With SQLite, the…
17
18
Log-log plot of new vs. total Covid-19 cases by country
Visualizing the exponential growth of COVID-19 across the world.
19
Jepsen: PostgreSQL 12.3
PostgreSQL is a major open-source relational database with a 23-year history and a broad range of features. While Jepsen’s work has traditionally focused on distributed systems, our tooling is readily applicable to traditional, single-node databases. In this report, we present the results of applying Jepsen’s…
20
What can 6,000 electric vehicles tell us about EV battery health?
Analysis of electric vehicle battery health of 22K+ EVs reveals a 2.3% average battery degradation rate. High-power DC fast charging is the top risk factor.
21
Personal Data Warehouses: Reclaiming Your Data
I gave a talk yesterday about personal data warehouses for GitHub’s OCTO Speaker Series, focusing on my Datasette and Dogsheep projects. The video of the talk is now available, and …
22
Pebble: A RocksDB Inspired Key-Value Store Written in Go
Today we’re introducing Pebble, a RocksDB-inspired and RocksDB compatible key-value store written in Go that brings greater stability to CockroachDB.
23
Jepsen: Etcd 3.4.3
The etcd key-value store is a distributed system intended for use as a coordination primitive. Like Zookeeper and Consul , etcd stores a small volume of infrequently-updated state ( by default, up to 8 GB ) in a key-value map, and offers strict-serializable reads, writes and micro-transactions across the entire…
24
How Does Sqlite Work? (2014)
How does SQLite work? Part 1: pages!
25
Writing a SQL database from scratch in Go
Writing a SQL database from scratch in Go: 1. SELECT, INSERT, CREATE and a REPL
26
27
SQLite 3.33
A complete list of SQLite releases in a single page and a chronology are both also available. A detailed history of every check-in is available at SQLite version control site .
28
TimescaleDB 2.0 released, now distributed multi-node
Fully managed PostgreSQL from the creators of TimescaleDB. 99.9% uptime SLA, 10,000+ IOPS, columnar compression up to 95%, and built-in search. Try it free.
29
Are CRDTs suitable for shared editing?
The sole purpose of this blog is to host a single article..
30
Common color mistakes and how to avoid them
Choosing good colors for your charts is hard. This article tries to make it easier.