Topics /
The most popular blog posts about databases & data on Hacker News. 242 posts.
Who’s this for Basics How data is stored in disk How indexes speedup access to data Costs associated with indexes Disk Space Write operations Query planner Memory usage Types of Indexes Btree Hash BRIN GIN GiST & SP-GiST Conclusion Who’s this for This text is for developers that have an intuitive knowledge of what…
How one unchecked login token put 17 trillion rows in a Microsoft internal analytics service within reach.
We discovered that entire sections describing domestic U.S. intelligence facilities were deliberately removed from two published documents, while equivalent foreign facilities remained visible. The evidence exists in an unexpected place - the PDF metadata of documents published by The Intercept in 2016, and by The…
The Only Programming Language Built on Mathematics, Not Fashion
Deploy globally, query over HTTP, and scale reads with low latency. Bunny Database lets you build fast without paying the serverless tax.
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
The actual queries I run when I'm hunting fraud in transaction data. Velocity, impossible distances, suspicious amounts, merchant clusters, off-hours buys, and window functions.
In 51,129 comments from six knife subreddits, the 5% most brand-heavy accounts wrote 11.3% of the brand mentions in buying threads, against 7.9% expected by chance. For one brand it is 31% against 8%. The full Reddit histories of those accounts are 4.5 years old and spread over 66 subreddits, the same as a comparison…
We built the same HTTP server in Go, Bun, and Rust using two storage strategies: read the file on every request, or load everything into memory. Then we ran real benchmarks. The results are more interesting than you'd expect.
Why DuckDB has become my go-to tool for data processing, offering simplicity, speed, and powerful features.
How I added Immich to my already robust photo management system to make it ridiculously robust.
We're open sourcing dbt Charts, a declarative language for dashboards, so that even the dashboards you build by chatting with an agent can be governed.
Explore Q2 2026 failure rates across 354,415 Backblaze drives, plus standout models and emerging CMR, SMR, and HAMR storage technologies.
Cloudflare K2 is a serverless event streaming service built directly on top of R2 object storage for high-scale data movement and long-term retention. By decoupling producers and consumers at the edge, K2 enables durable, ordered log streams without the operational overhead of traditional broker clusters.
Starting with v2.0, scheduled for fall 2026, DuckDB will support asynchronous reads of Parquet and CSV files. This can significantly speed up queries when synchronous I/O does not saturate the available bandwidth, as is typical in EC2/S3 compute-storage setups.
Neki, sharded Postgres by PlanetScale, is now available in platform preview.
Throughout Excel's 40-year history, you've only been able to put one value per cell. In this announcement, we're excited to share how that's changing with...
We're excited to announce the release of pandas 3.0.0. This major long-awaited release brings significant improvements to pandas, but also features some potentially breaking changes.
Exploring alternatives to the archived_at column pattern: triggers, application events, and WAL-based change data capture.
Python 3.14 added Zstandard to stdlib; its incremental API finally makes classify-by-compression practical.
Transitioning SQLite from a local development tool to a production-grade database requires a deep understanding of its internal mechanics. This article explores how to tune WAL mode, manage busy handlers, and leverage custom Virtual File System (VFS) layers to achieve ultra-low latency.
Learn how to use PostgreSQL as a Dead Letter Queue (DLQ) for event-driven systems. Case study from Wayfair showing how to handle failures in Kafka consumers with PostgreSQL.
The Apache Arrow project was officially established and had its first git commit on February 5th 2016, and we are therefore enthusiastic to announce its 10-year anniversary! Looking back over these 10 years, the project has developed in many unforeseen ways and we believe to have delivered on our objective of…
However recently it added a killer feature: generated columns . (This was added in 3.31.0, released 2020-01-22.)
Importing 1.2 million messages from Telegram, VK, Instagram, Facebook, and Twitter into a structured Obsidian vault with local LLM inference - to measure how my friendships work with decay curves, vocabulary shifts, directional sentiment, and conflict rates.
What are database transactions and how do SQL databases isolate one transaction from another?
.admonition { margin: .75em 0; padding: .6rem; overflow: hidden; font-size: 12px; page-break-inside: avoid; border-left: .3rem solid #42b983; border-radius: .3rem; box-shadow: 0 0.1re
