Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 151 posts.
Why Semantic Layers Matter (and how to build one with DuckDB)
Learn what a semantic layer is, why it matters, and how to build a simple one with DuckDB and Ibis using just YAML and Python | Reading time: 22 min read
PlanetScale for Postgres
PlanetScale now supports Postgres
Embedding user-defined indexes in Apache Parquet
Posted on: Mon 14 July 2025 by Qi Zhu (Cloudera), Jigao Luo (Systems Group at TU Darmstadt), and Andrew Lamb (InfluxData)
Using Vectorize to build an unreasonably good search engine in 160 lines of code
PartyKit now includes a vector database and access to an embedding model. Here’s a guide on how to use them to build a search engine.
JupyterGIS breaks through to the next level
Launched in June 2024, JupyterGIS was introduced as a collaborative, web-based GIS environment built on the JupyterLab framework. Its objective is to
PostgreSQL 18 Released
The [PostgreSQL Global Development Group](https://www.postgresql.org) today announced the release of [PostgreSQL 18](https://www.postgresql.org/docs/18/release-18.html), the latest version of the world's most advanced …
Julia and JuliaHub: Advancing Innovation and Growth
Explore Julia and JuliaHub's remarkable growth: 494% rise in Discourse views, +412% GitHub stars, and new products like Dyad.
Model Once, Represent Everywhere: UDA (Unified Data Architecture) at Netflix
Introducing UDA, the knowledge-graph-based architecture that translates conceptual domain models into consistent schemas and data…
A Python-first data lakehouse
Prototype in Marimo, deploy in Bauplan. Learn how to build production-grade pipelines from notebooks with a Python-native stack. No handoffs, no rewrites.
BM25 in PostgreSQL
VectorChord-BM25 enhances PostgreSQL search with BM25 ranking, 3x faster than ElasticSearch. Supports BERT, Tocken, and Unicode tokenizers
A new database on police use of force and misconduct in California
UC Berkeley Journalism offers a two-year Master of Journalism (MJ) degree and a summer minor, preparing students for careers in journalism.
Cursed Excel: "1/2"+1=45660
Explore Excel's bizarre date/time quirks—like “1/2”+1=45660—and how Quadratic fixes legacy issues with a modern approach to datetimes and spreadsheet logic.
Kaggle and the Wikimedia Foundation are partnering on open data
Kaggle is hosting Wikimedia Enterprise's beta release of structured data in both French and English. Kaggle is home to a vast trove of open and accessible data, with mor…
Scaling request logging with ClickHouse, Kafka, and Vector
How we solved request logging at scale by moving from MariaDB to ClickHouse, Kafka, and Vector after our deprecated database engine couldn't keep up with billions of monthly requests.
$50 PlanetScale Metal Is GA for Postgres
We've lowered the entry price for using PlanetScale Metal to $50 and added more flexibility in storage-to-compute ratios.
Time Series Forecasting with Graph Transformers
Introduction to Kumo Relational — the relational foundation model for predictive AI on relational data
Observability 2.0 and the Database for It
What Observability 2.0 means in practice, how wide events replace siloed metrics/logs/traces, and why GreptimeDB is purpose-built as the database foundation.
My Browser WASM't Prepared for This. Using DuckDB, Apache Arrow and Web Workers
by Przemyslaw Maciolek
A year of Rust in ClickHouse
This story is about how ClickHouse supports Rust components in the C++ code base and the challenges we had to overcome.
UUIDv7 Comes to PostgreSQL 18
PostgreSQL 18 adds native support for UUIDv7. A timestamp-based UUID variant that plays nicely with btree indexes. Here's what that means for you.
What’s New in PostgreSQL 18 – a Developer’s Perspective
PostgreSQL 18 features that change how application developers write and ship code.
Putting Andrew Ng's OCR models to the test
Testing Andrew Ng's document extraction service reveals over 50% hallucinated values in financial tables. | Pulse AI
Big Data was used to see if TCM was scientific (2023)
People love to show that skeptics were wrong about something, especially when national pride hangs in the balance. The South China Morning Post published the following headline on November 3rd: “Scientists find traditional Chinese medicine is based on a complex network of proteins – 3,000 years before modern science.”…
Alignment is not free: How model upgrades can silence your confidence signals
Delegate investigative work to AI agents, from L1 to L3 reviews, with consistency, auditability and traceability.
450× Faster Joins with Index Condition Pushdown
Introduction Readyset is designed to serve queries from cached views with sub-millisecond latency. This post focuses on the cold path—cases where a cache miss forces execution against the base tables. In these scenari...
MongoDB acquires Voyage AI
MongoDB to integrate Voyage AI's industry-leading embedding and reranking models, delivering highly accurate and relevant information retrieval to power sophisticated AI use cases NEW YORK , Feb. 24, 2025 /PRNewswire/ -- MongoDB, Inc. (NASDAQ: MDB), the leading database for modern applications,