1171
Colossus for Rapid Storage
Colossus’s performance comes from its stateful protocol, which plays a pivotal role in the new Rapid Storage offering launched at Google Cloud Next '25.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
1172
1173
Store SQLite in Cloudflare Durable Objects
This is my journey of creating a proof-of-concept of persisting an SQLite database in a Cloudflare Durable Object. It is not meant as a tutorial, but rather as something I myself can get back to it, to revisit what and why I did certain things.
1174
1175
Modern SQLite: Features You Didn't Know It Had
SQLite has evolved far beyond a simple embedded database. Explore modern features like JSON, FTS5, window functions, strict tables, and more.
1176
SQLite internals: How the most-used database works
Explore SQLite Internals: How The World's Most Used Database Works by Abdur-Rahmaan Janhangeer. Deep dive into database internals, systems engineering, and advanced Python.
1177
Cases where full scans are better than indexes
Sometimes you have a lot of data, and one approach to support quick searches is pre-processing it to build an index so a search can involve only looking at a small fraction of the total data. The threshold at which it's worth switching to indexing, though, might be higher than you'd guess. Here are some cases I've…
1178
Unexpected downsides of UUID keys in PostgreSQL
Understand how using UUIDs as primary keys can affect PostgreSQL performance, and how to tweak your index to avoid UUID performance pitfalls.
1179
Bug hunting in Btrfs
The other day I was implementing multi-threaded stat() calls in bfs . When I ran some benchmarks, I saw something that made my heart skip a beat:
1180
Don't use DISTINCT as a "join-fixer"
Using DISTINCT to fix duplicate rows from a SQL join is a common antipattern. It generates all the duplicates first, then sorts them away - hurting performance. Learn how to rewrite these queries using EXISTS for cleaner, faster SQL Server results.
1181
Call Me Maybe: Chronos
Chronos is a distributed task scheduler (cf. cron) for the Mesos cluster management system. In this edition of Jepsen , we’ll see how simple network interruptions can permanently disrupt a Chronos+Mesos cluster
1182
1183
An automatic indexing system for Postgres
The pganalyze Indexing Engine simulates hundreds of possible combinations to recommend missing Postgres indexes using its 'What if?' analysis.
1184
Discovering less-known Postgres v12 features
Get to know and learn how to use some less-known features of Version 12 of PostgreSQL. You'll surely discover something new for yourself.
1185
Searchcode.com’s SQLite database is probably 6 terabytes bigger than yours
searchcode.com’s SQLite database is probably one of the largest in the world, at least for a public facing website. It’s actual size is 6.4 TB. Which is probably 6 terabytes bigger than yours. …
1186
Books: an immutable double-entry accounting database service
Tracking financial transactions at scale
1187
Logstash joins Elasticsearch
Logstash is an open source data collection engine with real-time pipelining capabilities. Logstash can dynamically unify data from disparate sources and...
1188
To ORM or Not to ORM
I've been enjoying using Go's database/sql package for working with databases. Recently, some mentions of gorm piqued my curiosity about using ORMs in Go vs. using database/sql directly. Having had some mixed experiences with ORMs in the past, I decided to start with a practical experiment by writing the same simple…
1189
Migrating to Postgres
Since early 2022, Motion was on CockroachDB. Cockroach has many qualities going for it: effortless horizontal scaling, especially when…
1190
Why do we use R rather than Excel?
I recently had cause to take a beginners course in R - a language I'm fairly familiar with. One of the other students had never used it before, so we were buddied up in order for me to show them the ropes. The first lesson of R is always the same. Read a CSV, manipulate it a bit, draw a graph. We did it all without…
1191
You might not need Redis
Redis is arguably the most well regarded tech of all. But many times you do not need Redis. Here are 3 examples from my last 3 jobs.
1192
Hacker News “Who is Hiring?” top-level comments over time
tl;dr: I believe HN Who is Hiring? posts are down; scroll to the bottom for the chart, code lives here. Hacker News. The Orange Site. Since April 2011, it’s had a thread every month, which dares potential employers to answer one question: who is hiring? I take a quick skim through this thread every month. ... Hacker…
1193
Jepsen: TigerBeetle 0.16.11
TigerBeetle is an Online Transactional Processing (OLTP) database built for double-entry accounting with a strong emphasis on safety and speed. It builds on the Viewstamped Replication (VR) consensus protocol to offer Strong Serializable consistency. Unlike general-purpose databases, TigerBeetle stores only accounts…
1194
PartiQL: One query language for all your data
Data is being gathered and created at rates unprecedented in history. Much of this data is intended to drive business outcomes but, according to the Harvard Business Review, “…on average, less than half of an organization’s structured data is actively used in making decisions…” The root of the problem is that data is…
1195
A race condition in Aurora RDS
See how we diagnosed and confirmed an AWS Aurora RDS race condition impacting failovers.
1196
Build a search engine, not a vector DB
Don’t confuse embeddings with memory. To build effective RAG, start with a search engine, not just a vector database.
1197
We scaled PgBouncer to 4x throughput
PgBouncer is single-threaded, so a single process caps out at one CPU core no matter the box size. See how ClickHouse Managed Postgres runs a peered fleet of PgBouncer processes with so_reuseport to scale pooling across every core — with benchmarks showin
1198
Redis Geo
Note (version) : I wrote this originally as a Redis module in early 2014, then Redis included a modified version directly into official Redis releases in 2016. Note (implementation) : The implementation included with Redis 3.2+ changed some parameter orderings from my original (intentional, well-thought-out) design…
1199
Designing a SaaS Database for Scale with Postgres
Exploration of different architectures for designing a SaaS database that scales for multi-tenant data models, including one database per tenant, one schema per tenant, and having all tenants share the same tables. The right choice for you depends on whether you’re optimizing for scale or isolation.
1200
Plans for partitioning in PostgreSQL v11
The reaction to the new table partitioning feature in PostgreSQL 10 has been overwhelmingly positive, but a number of people have already as...