1
Sqlite – Most Deployed Database in the World
SQLite is likely used more than all other database engines combined. Billions and billions of copies of SQLite exist in the wild. SQLite is found in:
Most cited
Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 35 posts.
2
How Google Code Search Worked: Regex Matching with a Trigram Index (2012)
In the summer of 2006, I was lucky enough to be an intern at Google. At the time, Google had an internal tool called gsearch that acted as if it ran grep over all the files in the Google source tree and printed the results. Of course, that implementation would be fairly slow, so what gsearch actually did was talk to a…
3
Atomic Commit in SQLite (2007)
An important feature of transactional databases like SQLite is "atomic commit". Atomic commit means that either all database changes within a single transaction occur or none of them occur. With atomic commit, it is as if many different writes to different sections of the database file occur instantaneously and…
4
HTTP Analytics for 6M requests per second using ClickHouse
One of our large scale data infrastructure challenges here at Cloudflare is around providing HTTP traffic analytics to our customers. HTTP Analytics is available to all our customers via two options:
5
Why SQLite Does Not Use Git
SQLite does not use the Git version control system. SQLite uses Fossil instead, which is a version control system that was specifically designed and written to support SQLite.
6
Consistency Models
Jepsen analyzes the safety properties of distributed systems–most notably, identifying violations of consistency models. But what are consistency models? What phenomena do they allow? What kind of consistency does a given program really need?
7
Show HN: Domain-tailored CRDTs for collaboration without server involvement
An in-depth exploration of a new class of expressive, performant, and intuitive CRDTs, together with macOS and iOS sample code.
8
Why everything you have said about the determinants of health expenditure is wrong in one million charts: a response to Noah Smith.
Household income determines health spending, mostly via higher intensity, not prices. US behaviors are consistent with well-measured income in multiple dimensions.
9
10
The DeWitt Clause: Why You Rarely See Database Benchmarks
Back in the early 1980s, Dr. David DeWitt – who you might know from past PASS Summit keynotes, formerly of Microsoft (LinkedIn) – was working on measuring database performance. His team wrote a benchmark, ran it against Oracle, and Oracle didn’t fare well in the results. Oracle reacted as one would expect – they were…
11
Datomic: Event Sourcing without the hassle
When I got started using the Datomic database, I remember someone describing it to me as 'Event Sourcing without the hassle'. Having built Event Sourcing systems both with and without Datomic, I think this is very well put, although it might not be obvious, especially if you don't have much experience with Datomic.
12
13
Extracting Structured Data from Recipes Using Conditional Random Fields (2015)
Erica Greene describes the tool that she built to extract structured data from recipes.
14
NewSQL databases fail to guarantee consistency and I blame Spanner
(Spanner vs. Calvin, Part 2) [TL;DR I wrote a post in 2017 that discussed Spanner vs. Calvin that focused on performance differences. Th...
15
Backblaze Durability Is Eleven 9s – And Why It Doesn’t Matter
We’ve calculated Backblaze’s storage durability at 99.999999999%. What does that impressively large number mean, and does it actually matter for your data?
16
Jepsen: MongoDB 3.6.4
MongoDB is a long-time user of Jepsen . Over the past three years, Jepsen has performed several analyses for MongoDB, and MongoDB has integrated an expansive Jepsen test suite into their CI system. In March, MongoDB requested Jepsen perform an analysis on a previously untested configuration: sharded clusters. We also…
17
A summary of what quantitative trading firms do
This summary is an attempt to shed some light on modern quantitative trading since there is limited information available for people who are not already in the industry. Hopefully this is useful for students and candidates coming from outside the industry who are looking to understand what it’s like working for a…
18
FoundationDB Document Layer
Today we’re open sourcing the FoundationDB Document Layer, a document-oriented database that extends the core functionality of the FoundationDB key-value store.
19
20
SQL as an API language
Datasette (previously) is my open source tool for exploring and publishing structured data. There are a lot of ideas embedded in Datasette. I realized that I haven’t put many of …
21
Amazon DynamoDB Transactions
May 20, 2024: As of September 2022, DynamoDB now supports 100 items per transactions. March 13, 2020: Post updated to clarify how to use transactions with global tables and the increase in the maximum number of items per transaction from 10 to 25. Over the years, customers have used Amazon DynamoDB for lots of…
22
Amazon Aurora Backtrack
We’ve all been there! You need to make a quick, seemingly simple fix to an important production database. You compose the query, give it a once-over, and let it run. Seconds later you realize that you forgot the WHERE clause, dropped the wrong table, or made another serious mistake, and interrupt the query, but the […]
23
24
25
26
The Internals of Postgres – Concurrency Control
Concurrency Control is a mechanism that maintains atomicity and isolation, which are two properties of the ACID, when multiple transactions run concurrently in a database.
27
Problems with CSVs (2016)
Much of my professional work for the last 10+ years has revolved around handling, importing and exporting CSV files. CSV files are frustratingly misunderstood, abused, and most of all underspecified. While RFC4180 exists, it is far from definitive and goes largely ignored.
28
Improved fraud prevention with Radar 2.0
Radar 2.0 improves machine learning performance and reduces fraud by up to an additional 25%.
29
Experiences with running PostgreSQL on Kubernetes
An interview covering our experience running PostgreSQL on on-premises Kubernetes: challenges, open source and commercial tools, and alternatives for stateful apps.
30
Performance Benchmark 2018 – MongoDB, PostgreSQL, OrientDB, Neo4j and ArangoDB
The only enterprise AI data platform that cuts complexity, reduces costs, and gets you to production faster.