Topics /
The most popular blog posts about databases & data on Hacker News. 242 posts.
MariaDB is a popular open source SQL database which began as a fork of MySQL . MariaDB Galera Cluster is an active-active replication system for MariaDB which allows reads and writes on every node. In 2015 this author analyzed MariaDB with Galera Cluster and found that although Galera claimed to offer Snapshot…
This was a very old draft I’ve had sitting around for years. The recent discussions of new query languages like Acadia spurred me to revisit, revise, and publish this. I think one of the biggest causes of NoSQL is that… Continue reading →
There is an implicit contract at the foundation of every database architecture decision you have ever made. You probably never wrote it down. Nobody does. It just… existed.
Persistent agent memory on Elasticsearch: three-index architecture, hybrid retrieval, supersession and DLS isolation. R@10 0.89, zero cross-tenant leaks.
LLMs make good classifiers but even better features
One command-line tool to query them all, built with Rust and ADBC
I was recently trying to validate some performance improvements related to lld at $DAYJOB and it was a little frustrating to see the improvements in our benchmarks but not in the live-production dashboards.
In Python, the dict data structure is the conventional key-value structure. E.g., you might store a list of names as keys and have their phone numbers as values. Valentin Ignatev wrote this amusing post on X: It is indeed widely believed that, in the strict sense, the dict data structure and its companion, the set ……
This blog post has been archived! SpacetimeDB has improved a lot since I initially published this technical review, and most of the technical details in it no longer apply.
A recap on the work done in NumPy and CPython to make multi-threaded NumPy workloads scale on the free-threaded build of CPython.
LLMs will make more of your average stuff. And that's OK. Here's how average SQL beats fancy attribution models when your agent writes the queries.
Discover how Postgres managed by ClickHouse compares to its peers in a reproducible, open benchmark.
Data migrations are a critical part of the database lifecycle, and are sometimes necessary for version upgrades, sharding, or moving to a new platform. In many cases, migrations are painful and error-prone. In this article, we walk through how migrations are performed at PlanetScale, and offer advice on how to improve…
As my cat woke me up way too early for a Saturday morning, I decided to put all this extra time (and my ChatGPT Pro subscription) into good use and generated a QR-code generator for PostgreSQL, written as a single pure SQL statement. No external libraries or Postgres extension installation needed! The pqr.sql example…
This guide explains message queues with analogies: databases, warehouses and post offices.
Late interaction makes retrieval more precise but turns every document into many vectors. Asymmetric quantization keeps query vectors precise and stores…
Today, it’s my great pleasure to announce the first public release of Hardwood, a new parser for the Apache Parquet file format, optimized for minimal dependencies and great performance. Hardwood is …
Our latest ANN release supports scales of 100+ billion vectors in a single search index, with 200ms p99 query latency at 1k QPS and 92% recall.
What in the world is Explorative Modeling?
Turso is becoming the LLVM of databases: one modern, reliable Rust core with many SQL frontends. After rewriting SQLite, we are now building Postgres.
How good is the random_page_cost default, and should you lower it on modern flash storage?
Yes, for a supported subset of SQL. To establish a baseline, I integrated the SQLLogicTest suite.
A closed-form autoencoder: PCA encoder + quadratic Ridge decoder. On FiQA it gives 4× compression of mxbai-embed-large-v1 at -0.88 p.p. NDCG@10, +1.34 p.p. over PCA. No SGD, no neural networks.
Postgres SELECT DISTINCT performs surprisingly poorly. We explain why and how we mitigated it.
A new wave of litigation focused on violations of municipal regulations is emerging against multifamily housing landlords, many of whom are facing antitrust litigation targeting their use of certain revenue management products. The new regulations may potentially provide a simpler path to liability and the possibility…
The words are a subset of the 10,000 most common words from Google's Trillion Word Corpus , with definitions sourced from Open English Wordnet .
We ran a massive, sharded Postgres database at 118.5 million queries per second, with 200k queries per second on each shard across 512 shards.
Go 1.24 replaced the built-in map’s bucket-based runtime with Swiss Tables. This article explains groups, control bytes, H1 and H2, probing, table growth, directories, deletion, load factor, and the experimental split-group layout.
