Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 108 posts.
Bayesian statistics for confused data scientists
A gentle introduction to Bayesian statistics for data scientists who, like me, are confused by it.
The revenge of the data scientist
AI eval mistakes and the data science practices that fix them.
Fast drilldown dashboards from a single Parquet file
Range Requests Are All You Need
Matrix Multiplications on GPUs Run Faster When Given “Predictable” Data (2024)
Great minds discuss flops per watt.
How TimescaleDB compresses time-series data
TimescaleDB compression with hypercore - columnar storage with up to 98% ratio in PostgreSQL. segmentby/orderby configuration and a benchmark for IoT and time-series.
Three Six Mafia – Data about "6/6/6 dating" (2024)
Most guys my age have "the chat". The one with your college buddies that only exists to share memes, argue, bully, and occasionally announce that you got a promotion or had a kid. I am like most guys.
How Is Data Stored?
Invariably, it involves trying to trap electrons in increasingly complicated ways.
We are building data breach machines and nobody cares
A few weeks ago, my longstanding friend and colleague Curt Cunning mentioned to me that he was slogging through Nietzsche, which bespeaks his incredible will to power through things that are unpleasant (one of the many things that makes him an exceptional engineer). In any case, it lead me to revisit some of his work…
Does anyone run Postgres without PgBouncer?
Almost every notable managed Postgres provider bundles a connection pooler, giving us a strong hint that connection management is a product problem rather than a user problem.
Scientific datasets are riddled with copy-paste errors
Initial results from scanning through Excel files belonging to 600 published scientific papers.
Speculative KV coding: losslessly compressing KV cache by up to ~4×
Lossless compression of a target model's KV cache by up to 4×, using a cheaper predictor model to drive an arithmetic coder.
One Hash Bloom Filters
Jim Calabro
Why the KeePass format should be based on SQLite
Mohammed Ketab
Google Street View in 2026
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
Let's Build PlanetScale from Scratch: Infrastructure
Homescale, PlanetScale at home.
Finding the best dog treat with statistics
I ran a pairwise-choice experiment on my Greyhound to rank his favorite treats, measure side bias, and accidentally turn bedtime snacks into a statistics problem.
Data Manipulation in Clojure Compared to R and Python
I spend a lot of time developing and teaching people about Clojure's open source tools for working with data. Almost everybody who wants to use Clojure…
Linux 7.0 Broke PostgreSQL: The Preemption Regression Explained
Linux 7.0 delivered roughly half the throughput of Linux 6.x on the same hardware and workload.
Algorithms on billion-scale graph using 10GB RAM: I love DataFusion
In a previous post, I was sceptical about using Apache DataFusion for graph analytics. However, after some thought and experimentation, I changed my mind. I have reconsidered my approach and now have a working implementation of basic graph algorithms, such as WCC, PageRank and MSSP. For example, I can identify weakly…
Guide to data tools landscape for developers
Found yourself on a data project and have no idea what they all are talking about? Feel excluded from all the fun discussions in the office kitchen? If only there were a humongous guide going over all the concepts and buzzwords...
Visualizing Binary Files
It's all black and white, basically. A while ago, Vim's xxd gained the ability to color the output (this is not included in Vim Classic , which I use):
Can we replace a $150k Looker with a bucket of HTML files?
(BI) Software is dead, apparently
Spanish traders set the standard for GnuCash database design
TLDR: Spanish traders in the 1600s did not want to count their thumbs, which influenced GnuCash's database design choices in 1997. Much like a horse's arse set the standard for railways . How seemingly odd design turns out to be a genius solution that serves people pretty well.
dBase: 1979-2026
Litigation, neglect killed dBase. The dBase newsgroup servers went off-line since November 2025. Court-smart dBase vendors and AI accelerated the fall.
Columnar Storage Is Normalization
Something I didn't understand for a while is that the process of turning row-oriented data into column-oriented data isn't a totally bespoke, foreign concept...
C# strings silently kill your SQL Server indexes in Dapper
If you're using Dapper with anonymous objects to query varchar columns, you're probably sending nvarchar(4000) parameters — causing CONVERT_IMPLICIT on every row and defeating your indexes. Here's the fix.
Pandas Exercises for Data Analysis (Interactive)
101 interactive pandas exercises with solutions. Edit and run every code block directly in your browser — no installation needed.