31
Pre-Release of Polars 2.0
Preview of Python Polars 2.0, bringing the streaming engine to all lazy queries
New
The latest blog posts to take off on Hacker News. 2,337 posts.
32
Algorithmic rent-pricing litigation expands under new state and local laws
A new wave of litigation focused on violations of municipal regulations is emerging against multifamily housing landlords, many of whom are facing antitrust litigation targeting their use of certain revenue management products. The new regulations may potentially provide a simpler path to liability and the possibility…
33
34
Python Polars Cheatsheet (based on our O'Reilly book)
Quick reference guide for transforming, analyzing, and visualizing data with Python Polars.
35
36
A Preview of DuckDB v2.0
DuckDB 2.0 is coming this fall. In this post, we preview its headline features: DuckDB as a server, triggers, the VARIANT type, asynchronous I/O, a new SQL parser, a new storage format, and much more.
37
Breaking the WAL
I did this from a lawn chair on the Sunshine Coast.
38
Grok 4.6 scores 61 on the Artificial Analysis Intelligence Index
SpaceXAI returns to the intelligence frontier with strengths in agentic performance and cost efficiency
39
Tracking down the 16-year-old WAL-reset SQLite bug
Tailscale and SQLite developers traced maddening corruption incidents to find the WAL-Reset data race, then uncovered a second stale expression index bug.
40
Asynchronous I/O in DuckDB: Work, Thread, Work
Starting with v2.0, scheduled for fall 2026, DuckDB will support asynchronous reads of Parquet and CSV files. This can significantly speed up queries when synchronous I/O does not saturate the available bandwidth, as is typical in EC2/S3 compute-storage setups.
41
How We Pushed CDC into Postgres
Discover Snowflake Postgres Mirroring. Learn how push-based change data capture delivers transactional replication to your data lake with zero lag.
42
We replaced Redis with MySQL for inventory reservations and it scaled
How we used SKIP LOCKED, composite primary keys, and connection visibility to hit our scale targets.
43
An all-sky map of half a million supermassive black holes
The Black Hole Mapper reaches a milestone with its first southern hemisphere optical observations, coordinated eROSITA X-ray identification, and multi-epoch tracking of accreting black holes across the universe.
44
Beating GPT-5.6 Sol on retrieval with 100x cheaper open models
A 4B open-source model post-trained with Castform retrieved search results as accurately as GPT-5.6 Sol, while costing 100x less.
45
DuckDB – Data power tools for your laptop, now in Clojure (2023)
A well-written, *FAST* data science database for your laptop.
46
Andy Pavlo joins ClickHouse to establish ClickHouse Labs
I am excited to announce that I am joining ClickHouse, Inc. to establish and lead a new research team at ClickHouse Labs.
47
Massively Parallel Postgres Backups
PlanetScale backs up petabyte-scale sharded Postgres databases in hours using parallel infrastructure, object storage, and WAL replay.
48
Making Postgres queues scale
Lessons learned from scaling Postgres-backed durable queues for users running tens of billions of workflows per month.
49
Scaling NumPy on Free-Threaded Python
A recap on the work done in NumPy and CPython to make multi-threaded NumPy workloads scale on the free-threaded build of CPython.
50
SQLite in Production: Optimizing WAL Mode, Concurrency, and VFS Layers
Transitioning SQLite from a local development tool to a production-grade database requires a deep understanding of its internal mechanics. This article explores how to tune WAL mode, manage busy handlers, and leverage custom Virtual File System (VFS) layers to achieve ultra-low latency.
51
Postgres LISTEN/NOTIFY actually scales
How we optimized Postgres LISTEN/NOTIFY-backed data streams to 60K writes per second on a single Postgres server, with millisecond-scale latency.
52
The startup's Postgres survival guide
A guide to preventing Postgres from toppling over.
53
We're Building Postgres in Rust. Using the LLVM of Databases
Turso is becoming the LLVM of databases: one modern, reliable Rust core with many SQL frontends. After rewriting SQLite, we are now building Postgres.
54
Making 768 servers look like 1
How to make 768 distinct Postgres servers look like 1 to your applications.
55
We scaled PgBouncer to 4x throughput
PgBouncer is single-threaded, so a single process caps out at one CPU core no matter the box size. See how ClickHouse Managed Postgres runs a peered fleet of PgBouncer processes with so_reuseport to scale pooling across every core — with benchmarks showin
56
GLM 5.2 is nearly as accurate as a human book keeper
A real quarter of UK SME books, 59 transactions, 68 minutes, $2.73 of tokens — and a VAT return within 7 pence of the human-prepared one.
57
Pruning RAG context down to what the answer actually needs
Pruning agent context down to what the answer actually needs, while keeping 96% of recall
58
PostgreSQL and the OOM killer: Why we use strict memory overcommit
In this blog post, we will explain how strict memory overcommit protects your database from catastrophic OOM (out of memory) kills. We will also share how a one character kernel bug forced us to temporarily disable this setting. Finally, we will explain our heuristic for determining the right memory overcommit limit…
59
Postgres transactions are a distributed systems superpower
Keeping workflow state and application data in the same Postgres database lets one transaction update both, simplifying idempotency and atomicity.
60
Postgres data stored in Parquet on S3: LTAP architecture explained
Almost every traditional database keeps its write-ahead log and data files on one machine's disk, which is the root cause of data loss risk, expensive read replicas and high-availability clones, and analytics queries that drag down transactions.