61
ClickHouse acquires Langfuse
Our goal continues to be building the best AI engineering platform
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 134 posts.
62
Looking Ahead to Postgres 19
Discover the top PostgreSQL 19 features, including built-in REPACK CONCURRENTLY, SQL property graph queries (SQL/PGQ), and logical replication updates.
63
How we index images for RAG
Reading the screenshots, diagrams and tables in technical documentation for LLMs
64
OpenTelemetry profiles enters public alpha
Since OpenTelemetry first introduced Profiles, momentum has only grown towards building a unified industry standard for continuous production profiling, standing alongside traces, metrics, and logs. Today, the Profiling SIG is proud to announce that the Profiles signal has officially entered public Alpha, and we are…
65
Python Polars Cheatsheet (based on our O'Reilly book)
Quick reference guide for transforming, analyzing, and visualizing data with Python Polars.
66
The only scalable delete in Postgres is DROP TABLE
Large DELETEs add work instead of reclaiming it. Structure your database so deletion becomes DROP TABLE or TRUNCATE.
67
PostgreSQL and the OOM killer: Why we use strict memory overcommit
In this blog post, we will explain how strict memory overcommit protects your database from catastrophic OOM (out of memory) kills. We will also share how a one character kernel bug forced us to temporarily disable this setting. Finally, we will explain our heuristic for determining the right memory overcommit limit…
68
Does Postgres Scale?
Benchmarking the workflow execution and workflow queueing scalability of a single Postgres server.
69
An all-sky map of half a million supermassive black holes
The Black Hole Mapper reaches a milestone with its first southern hemisphere optical observations, coordinated eROSITA X-ray identification, and multi-epoch tracking of accreting black holes across the universe.
70
Moving our warehouse off DuckDB
We moved our warehouse product off DuckDB and DuckLake onto our own flavor of Trino and a new open table format, HogLake. Here's what broke at scale and why.
71
Chess in SQL
What if I told you SQL could play chess? No JavaScript, no frameworks - just pure SQL rendering a full chess board in your browser.
72
Can you use autoregressive diffusion to generate market data?
The following is part of a series of posts about 2026 summer intern projects – for more, see “What the interns have wrought, special jumbo 2026 edition”
73
NanoGPT Slowrun: Language Modeling with Limited Data, Infinite Compute
NanoGPT Slowrun is an open effort to implement data-efficient learning algorithms; 5.5x data efficiency in the first week and improving.
74
Two Bits Are Better Than One: making bloom filters 2x more accurate
Optimisation of bloom filters in Floe using double bit setting with lightweight hashing.
75
Zombie stats: Where the numbers AI quotes come from
We asked five AI assistants 200 questions that call for a number and followed 1,285 of the statistics they cited back to the source.
76
Postgres data stored in Parquet on S3: LTAP architecture explained
Almost every traditional database keeps its write-ahead log and data files on one machine's disk, which is the root cause of data loss risk, expensive read replicas and high-availability clones, and analytics queries that drag down transactions.
77
Postgres isn't slow, your storage is
A recap of Sai Srirampur's POSETTE 2026 talk on storage performance in Postgres, with a local NVMe vs. EBS benchmark and the production setup behind it.
78
Making geo joins faster with H3 indexes
Using H3 indexes to greatly speed up geospatial SQL Queries. Orders of magnitude improvements can be gained with the right data structures
79
A distributed queue in a single JSON file on object storage
How to build a single global queue for distributed systems on object storage: Start with a single file on object storage, then add write batching, a stateless broker, and high-availability.
80
Footguns with Postgres “at time zone 'UTC'”
And why you may need to repeat AT TIME ZONE 'UTC' twice. SUMMARY * AT TIME ZONE 'UTC' converts the data type from timestamptz to timestamp (example). * Now you are inadvertently using the timestamp without time zone (aka timestamp) data type, which is markedly discouraged. * There are tons of footguns with timestamp…
81
NanoGPT Slowrun: 10x Data Efficiency with Infinite Compute
We've achieved 10x data efficiency with NanoGPT Slowrun within a few weeks. An ensemble of 1.8B parameter models (18B total params) trained on 100M tokens matches what would normally require 1B tokens with a standard LM baseline. Data efficiency matters because compute grows much faster than data . Since our current…
82
DuckDB 1.5.2 – SQL database that runs on laptop, server, in the browser
We are releasing DuckDB version 1.5.2, a patch release with bugfixes, performance improvements, and support for the DuckLake 1.0 lakehouse format.
83
A type-safe, realtime collaborative Graph Database in a CRDT
Open-source TypeScript property graph database from codemix.
84
Backblaze Drive Stats for 2025
Backblaze's 2025 Year-End Drive Stats Report provides an in-depth analysis of hard drive failure rates for Q4, the full year, and lifetime performance across its data center fleet.
85
Releasing rainbow tables to accelerate Net-NTLMv1 protocol deprecation
Mandiant aims to lower the barrier for security professionals to demonstrate the insecurity of Net-NTLMv1.
86
Breaking the WAL
I did this from a lawn chair on the Sunshine Coast.
87
Elasticsearch was never a database
Elasticsearch is a search engine, not a database. Here's why it falls short as a system of record.
88
Artificial Analysis Intelligence Index v4.2
We are accelerating elements of our upcoming v5 release with interim updates to keep pace with the frontier. Index v4.2 has more complex and realistic tasks, and more private test sets to prevent gaming
89
Making 768 servers look like 1
How to make 768 distinct Postgres servers look like 1 to your applications.
90
Gemini API File Search is now multimodal
Updates to the Gemini API File Search tool makes building efficient, multimodal file retrieval systems easier for developers.