Top posts
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 4,225 posts.
DeepSeek's smallpond: Bringing Distributed Computing to DuckDB
DeepSeek is pushing DuckDB beyond its single-node roots with smallpond, a new, simple approach to distributed compute. But does it solve the scalability challenge—or introduce new trade-offs?
AWS Babelfish: The Elephant in the PostgreSQL Room?
Fundación PostgreSQL
They say that stocks go down during the day and up at night
Prompted by your blog post this morning, I attach a plot from Figure 3 of They Still Haven’t Told You showing overnight and intraday returns to AIG (with logarithmic vertical scale, updated with data through the end of October).
Do you need Redis? PostgreSQL does queuing, locking, and pub/sub (2021)
It's a common architecture to have PostgreSQL and Redis serve as the backbone of your app, but PostgreSQL may be capable of everything you use Redis for.
Backblaze Hard Drive Stats Q3 2019
A problem that would have been discovered in the future would now be captured by the SMART stats when the process reads that section of disk today.
A bird's eye view of Polars
Read how Polars executes your query from planning, optimizing to execution.
Search at Slack
On average, 20% of a knowledge worker’s day is spent looking for the information they need to get their work done. If you think about a typical work week, that means an entire day is dedicated to this task! To help our users find more time in their day, the Search, Learning, and Intelligence team set…
FoundationDB: A distributed unbundled transactional key value store
This paper from Sigmod 2021 presents FoundationDB, a transactional key-value store that supports multi-key strictly serializable transacti...
Cross-Database Queries in SQLite
I released Datasette 0.55 and sqlite-utils 3.6 this week with a common theme across both releases: supporting cross-database joins. Cross-database queries in Datasette SQLite databases are single files on disk. …
Finding Java Thread Leaks with JDK Flight Recorder and a Bit of SQL
The other day at work, we had a situation where we suspected a thread leak in one particular service, i.e. code which continuously starts new threads, without taking care of ever stopping them again. …
SQLite Release 3.8.11.1
A complete list of SQLite releases in a single page and a chronology are both also available. A detailed history of every check-in is available at SQLite version control site .
Implementing "seen by" functionality with Postgres
Different approaches for tracking visitor counts with PostgreSQL.
SedonaDB: A new geospatial DataFrame library written in Rust
Apache Sedona is a cluster computing system for processing large-scale spatial data. Sedona extends existing cluster computing systems, such as Apache Spark, Apache Flink, and Snowflake, with a set of out-of-the-box distributed Spatial Datasets and Spatial SQL that efficiently load, process, and analyze large-scale…
Demystifying Apache Arrow (2020)
Demystifying Apache Arrow - some observations from a data scientist. Learning more about a tool that can filter and aggregate two billion rows on a laptop in two seconds
Building rqlite 9.0: Cutting disk usage by half
rqlite is a lightweight, open-source, distributed relational database written in Go. It is built on the Raft consensus protocol and uses SQLite as its storage engine. Development of 9.0 has begun and aims to reduce disk usage by approximately 50%. This goal will be achieved through a high-level design overhaul…
Extra security measures for next week's releases
The core committee has decided that one of the security issues due to be fixed next week is sufficiently bad …
PostgreSQL Templates
What are PostgreSQL templates and what are they used for?
GpuScan and SSD-To-GPU Direct DMA
An article for none-Japanese readers....What I'm recently working on is a feature to load data blocks from NVMe-SSD to GPU using peer-to-peer DMA. It allows to bypass the CPU/RAM under a series of data loading process, thus, also allows to reduce number of expensive data copy. Once data blocks are l…
The Internals of Postgres – Concurrency Control
Concurrency Control is a mechanism that maintains atomicity and isolation, which are two properties of the ACID, when multiple transactions run concurrently in a database.
Understanding Kafka with Factorio (2019)
While playing Factorio the other day, I was struck by the many similarities with Apache Kafka.
Announcing MongoDB 3.0
Official MongoDB Documentation. Learn to store data in flexible documents, create an Atlas deployment, and use our tools and integrations.
Spotify Optimized the Largest Dataflow Job Ever for Wrapped 2020
In this post we’ll discuss how Spotify optimized and sped up elements from our largest Dataflow job, , for using a technique called Sort Merge Bucket (SMB) join. We’ll present the design and implementation of SMB and how we incorporated it into our data pipelines.
The only scalable delete in Postgres is DROP TABLE
Large DELETEs add work instead of reclaiming it. Structure your database so deletion becomes DROP TABLE or TRUNCATE.