Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
Understanding Smallpond and 3FS
A concise breakdown of what smallpond and 3FS are, how to use them, and if they're suitable for your data processing needs.
Visualizing 13M Bluesky users
Joel Gustafson
We cut our Mongo DB costs by 90% by moving to Hetzner
We moved MongoDB Atlas off AWS and onto self-hosted Hetzner boxes — 90% cost cut, no performance loss. Here's the setup, the Ansible, and what broke.
Airflow's Problem
In 2022, data engineers manage forests, not trees
Short Message Compression Using LLMs
ts_sms works similarly to ts_zip . It uses a specific padding system compatible with arithmetic coding so that the message length does not need to be explicitly encoded.
Spiral
Data 3.0, backed by the best
Polars Cloud: The Distributed Cloud Architecture to Run Polars Anywhere
We introduce Polars Cloud, the distributed cloud architecture to scale and run Polars anywhere.
MongoBleed Explained Simply
CVE-2025-14847 allows attackers to read any arbitrary data from the database's heap memory. It affects all MongoDB versions since 2017, here's a simple explanation:
MinIO: A Bare Metal Drop-In for AWS S3
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
How We Built Fly Postgres
The database. The app. The legend.
SQLite in Production: Optimizing WAL Mode, Concurrency, and VFS Layers
Transitioning SQLite from a local development tool to a production-grade database requires a deep understanding of its internal mechanics. This article explores how to tune WAL mode, manage busy handlers, and leverage custom Virtual File System (VFS) layers to achieve ultra-low latency.
Python For Feature Film
A look into how Python is used to bring your favorite movies to the big screen.
Last Mile Redis
Documentation and guides from the team at Fly.io.
Practical Data Science in Python
Find, classify and remediate PII across your files, email, databases and cloud. Accurate AI-powered PII discovery – on-premise or SaaS.
You Can’t Do Data Science in a GUI
The Domino Data Lab blog is home to all things data science and machine learning, with information and resources tailored to data science professionals.
Why SELECT * is bad for SQL performance (2020)
Here’s a list of reasons why SELECT * is bad for SQL performance, assuming that your application doesn’t actually need all the columns. When I write production code, I explicitly specify the columns of interest in the select-list (projection), not only for performance reasons, but also for application reliability…
Tricking PostgreSQL into using an insane, but faster, query plan
At Spacelift, we use PostgreSQL (specifically Aurora Serverless) for most of our primary database needs. This article will show you our optimization story and how PostgreSQL row count estimation can go very wrong.
Exactly-once Semantics: How Kafka Does it
Exactly-once is a hard problem to solve, but we've done it. Available now in Apache Kafka 0.11, exactly-once semantics.
CouchDB 2.0
The Apache CouchDB development community is proud to announce the immediate availability of version 2.0. See also the official Apache Press Release. CouchDB 2.0 is 99% API compatible with the 1.x s…