Unconventional PostgreSQL Optimizations
Creative ideas for speeding up queries in PostgreSQL
Creative ideas for speeding up queries in PostgreSQL
Discover ENAS, the license-free enterprise storage platform featuring native ZFS, secure UniFi management, scalable petabyte-class capacity, multi-site backups, and shared iSCSI storage for modern business infrastructure.
turbopuffer is pushing the frontier of search. To do that, we have to fundamentally redesign our storage architecture so the vector index is no longer primary.
Preview of Python Polars 2.0, bringing the streaming engine to all lazy queries
What is machine learning? See how it works with our animated data visualization.
What does this vagueness by-design mean for how we choose to self monitor our biological markers?
In September 2014 I published a short post announcing rqlite. The idea was simple: take SQLite, put a Raft log in front of it, and replicate every write to a cluster so that the loss of a node did not mean the loss of the data. The source went on GitHub that same weekend. As…
DuckDB instances can now talk to each other using the Quack remote protocol. This lets you run DuckDB in a client-server setup with multiple concurrent writers. In DuckDB's spirit, Quack is simple to set up and builds on proven technologies such as HTTP. It's also fast, which allows it to support workloads ranging…
How does the latest entry-level MacBook perform on database workloads? We benchmarked it using ClickBench and TPC-DS SF300. We found that it could complete both workloads, sometimes with surprisingly good results.
Andy Warfield writes about the hard-won lessons dealing with data friction that lead to S3 Files
How we optimized Postgres LISTEN/NOTIFY-backed data streams to 60K writes per second on a single Postgres server, with millisecond-scale latency.
A new paper in Psychological Science (.htm) reports a failure to replicate Study 2 of Ariely and Wertenbroch’s influential article entitled, “Procrastination, Deadlines, and Performance: Self-Contr…
Sound economic planning and policymaking requires trustworthy data. Private data can serve as a complement but not fully replace official U.S. statistics.
Modern applications often spread state across a variety of systems: databases, caches, queues, data warehouses, search indices, and so on. Coordinating these systems is challenging: caches are often stale, the analytics platform might lag days behind the primary database, the search index might lose data, and…
I prefer strict tables in SQLite because they avoid some datatype problems, such as putting text in number columns.
Explaining the concept of a Postgres-backed durable execution system like DBOS and comparing it to external workflow orchestration systems like Temporal.
An inside look at how OpenAI scaled PostgreSQL to millions of queries per second using replicas, caching, rate limiting, and workload isolation.
How we used SKIP LOCKED, composite primary keys, and connection visibility to hit our scale targets.
SpaceXAI returns to the intelligence frontier with strengths in agentic performance and cost efficiency
I was pleasantly surprised and happy to see that my article ‘Your executable is a SQLite database’ resonated with people. It is a format I have been thinking about for a while, and the idea seems to have struck a chord with others.
Last week we released version 0.2 of pgrust. This release was all about performance. It’s 10x faster than the previous version of pgrust. On OLTP benchmarks, pgrust is 30% faster than Postgres, and on Clickbench, Clickhouse’s benchmark for analytical databases, pgrust is 300x faster than Postgres. It’s even ahead of…
I am excited to announce that I am joining ClickHouse, Inc. to establish and lead a new research team at ClickHouse Labs.
Google’s Gemini 4 Carbon is the new #1 on the Artificial Analysis Intelligence Index v5, and second only to Claude Opus 5.5 on the Artificial Analysis Coding Agent Index
We introduce "observed exposure," combining LLM capability with real Claude usage data, and share early evidence on employment effects.
49 graphics cards. 30 years. From Quake to Cyberpunk.
ClickHouse was released in open source on Jun 15 2016, ten years ago. Since then, it became the most popular open source analytical database with more than 2000 contributors.
Who’s this for Basics How data is stored in disk How indexes speedup access to data Costs associated with indexes Disk Space Write operations Query planner Memory usage Types of Indexes Btree Hash BRIN GIN GiST & SP-GiST Conclusion Who’s this for This text is for developers that have an intuitive knowledge of what…