New
The latest blog posts to take off on Hacker News. 4,224 posts.
Fabric Is Just Plain Unreliable, and Microsoft's Hiding It
Update 2025/07/21: Microsoft heard the complaints, and fixed the reliability added a better status page. Baby steps. Last week, Microsoft Fabric went down yet again for hours on multiple continents. Oh, you didn’t hear about it? Let’s talk about why. First, Fabric’s status page is fabricated bullshit. The link…
A lost decade chasing distributed architectures for data analytics?
We benchmark DuckDB on a 2012 MacBook Pro to decide: did we lose a decade chasing distributed architectures for data analytics?
The principles of database design, or, the Truth is out there
Every software project needs to represent the reality of the business he is embedded in. The way we can represent reality as limited rational beings is through propositions, i.e, declarative statements that affirm or deny something about reality. When a collection of such propositions is stored in a computer system…
Getting AI to write good SQL
Learn about text-to-SQL techniques like context building and table retrieval, LLM-as-a-judge, and LLM prompting and post-processing.
Migrating to Postgres
Since early 2022, Motion was on CockroachDB. Cockroach has many qualities going for it: effortless horizontal scaling, especially when…
Databricks acquires Neon
Databricks agrees to acquire Neon, a serverless Postgres database company, to bring speed and flexibility to production workloads.
Build real-time knowledge graph for documents with LLM
Build a Neo4j knowledge graph from Markdown documents with an LLM. CocoIndex updates the extracted relationships as documents change.
OpenTelemetry protocol with Apache Arrow
We are excited to announce the next phase of the OpenTelemetry Protocol with Apache Arrow project (OTel-Arrow). We began this project several years ago with the goal of bridging between OpenTelemetry data and the Apache Arrow ecosystem. Apache Arrow is a framework designed for zero-copy exchange of structured data…
Continuous glucose monitors reveal variable glucose responses to the same meals
In this exploratory analysis of 2 highly controlled crossover studies in 30 participants without diabetes, the same meals led to highly variable glucose responses, as measured with continuous glucose monitors.
21 GB/s CSV Parsing Using SIMD on AMD 9950X
Sep 0.10.0 was released April 22nd, 2025 with optimizations for AVX-512 capable CPUs like the AMD 9950X (Zen 5) and updated benchmarks including the 9950X. Sep now achieves a staggering 21 GB/s on the 9950X for the low-level CSV parsing. 🚀 Before 0.10.0, Sep achieved ~18 GB/s on 9950X.
OpenSearch 3.0 Released
The OpenSearch Software Foundation today announced the general availability of OpenSearch 3.0. This major release delivers a 9.5x performance improvement over OpenSearch 1.3, building on benchmarking data that showed earlier iterations of OpenSearch operating 1.6x faster than its closest industry competitor.
Waiting for Postgres 18: Accelerating Disk Reads with Asynchronous I/O
Postgres 18 introduces Asynchronous I/O (AIO) that can dramatically improve read performance, especially in the cloud. Learn how these changes and the new io_method setting work and see why our benchmark results show that io_uring is the recommended setting for maximizing I/O performance in Postgres 18 over the…
Alignment is not free: How model upgrades can silence your confidence signals
Delegate investigative work to AI agents, from L1 to L3 reviews, with consistency, auditability and traceability.
DuckDB is probably the most important geospatial software of the last decade
DuckDB’s spatial extension cut geo setup to two lines of SQL, and interest in geospatial data turned upward the moment it shipped.
Bloom Filters
The original motivation for the creation of Bloom filters is efficient set membership, using a probabilistic approach to significantly reduce the time and space required to reject items that are not members in a certain set.
Derivation and Intuition behind Poisson distribution
Made in Notion, the connected workspace where AI agents and teams organize docs, projects and knowledge together.
A faster way to copy SQLite databases between computers
Dumping a SQLite database to a text file can make it much smaller, which means you can download it faster.
Jepsen: Amazon RDS for PostgreSQL 17.4
AWS’s Sergey Melnik, along with HN commenters matashii and Ants Aasma, have identified the cause of Long Fork in PostgreSQL clusters. As described a 2013 mailing list post , the order in which a PostgreSQL primary makes transactions visible is determined by an in-memory lock. Secondaries, however, make transactions…
How NASA Is Using Graph Technology and LLMs to Build a People Knowledge Graph
Missed NASA’s People Graph webinar? Catch the recap and see how graph technology and AI are shaping the future of workforce intelligence.
Reverse geocoding is hard
My wife and I run OpenBenches - a crowd-sourced database of nearly 40,000 memorial benches. Every bench is geo-tagged with a latitude and longitude. But how do you go from a string of digits to something human readable? How do I turn -33.755780,150.603769 into "42 Wallaby Way, Sydney, Australia"? Luckily, that's a…
Shardines: SQLite3 Database-per-Tenant with ActiveRecord
There is a pattern I am very fond of - “one database per tenant” in web applications with multiple, isolated users. Recently, I needed to fix an application I had for a long time where this database-per-tenant multitenancy utterly broke down, because I was doing connection management wrong. Which begat the question…
Anatomy of a SQL Engine
Blog for DoltHub, a website hosting databases made with Dolt, an open-source version-controlled SQL database with Git-like semantics.
Observability 2.0 and the Database for It
What Observability 2.0 means in practice, how wide events replace siloed metrics/logs/traces, and why GreptimeDB is purpose-built as the database foundation.
Street address errors in Google Maps
(or actually they do, but they don’t use this knowledge effectively)Update, April 26, 2025: the address fix for W 6th Ave is live, mostly. Going forward I wish that Google Maps would make it harder…
Instant SQL for results as you type in DuckDB UI
Type, see, tweak, repeat! Instant SQL is now in Preview in MotherDuck and the DuckDB Local UI. Bend reality with SQL superpowers to get real-time query results as you type. | Reading time: 8 min read
ClickHouse gets lazier and faster: Introducing lazy materialization
ClickHouse learned to procrastinate strategically. Discover how lazy materialization skips unnecessary column reads to accelerate queries.
Decomposing Transactional Systems
Every transactional system must execute, order, validate, and persist transactions.
Dumb statistical models, always making people look bad
This is Jessica. In my Prediction for Decision-making class last quarter we talked about human predictions and decisions relative to algorithmic ones. This led to a discussion about why it’s often hard to demonstrate the value of human knowledge once you have a decent statistical model.