Topics /

Databases & Data

The most popular blog posts about databases & data on Hacker News. 148 posts.

2025
11

Visualizing all books of the world in ISBN-Space

Libraries have been trying to collect humanity’s knowledge almost since the invention of writing. In the digital age, it might actually be possible to create a comprehensive collection of all human writing that meets certain criteria. That’s what shadow libraries do - collect and share as many

13

Mini NASes marry NVMe to Intel's efficient chip

I'm in the process of rebuilding my homelab from the ground up, moving from a 24U full-size 4-post rack to a mini rack. One of the most difficult devices to downsize (especially economically) is a NAS. But as my needs have changed, I'm bucking the trend of all datahoarders and I need less storage than the 120 TB (80…

20

The Case Against PGVector

The real limitations of pgvector in production: index choice between IVFFlat and HNSW, why real-time search is hard, pre- vs post-filtering pain, how performance degrades at scale, and when a dedicated vector database is the better call.

23

Redis is fast – I'll cache in Postgres

There are books & many articles online, like this one arguing for using Postgres for everything. I thought I’d take a look at one use case - using Postgres instead of Redis for caching. I work with APIs quite a bit, so I’d build a super simple HTTP server that responds with data from that cache. I’d start from Redis…

27

21 GB/s CSV Parsing Using SIMD on AMD 9950X

Sep 0.10.0 was released April 22nd, 2025 with optimizations for AVX-512 capable CPUs like the AMD 9950X (Zen 5) and updated benchmarks including the 9950X. Sep now achieves a staggering 21 GB/s on the 9950X for the low-level CSV parsing. 🚀 Before 0.10.0, Sep achieved ~18 GB/s on 9950X.

29

Hard problems that reduce to document ranking

There are two claims I’d like to make: LLMs can be used effectively1 for listwise document ranking. Some complex problems can (surprisingly) be solved by transforming them into document ranking problems. I’ve primarily explored both of these claims in the context of using patch diffing to locate N-day…