211
Julia and JuliaHub: Advancing Innovation and Growth
Explore Julia and JuliaHub's remarkable growth: 494% rise in Discourse views, +412% GitHub stars, and new products like Dyad.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 299 posts.
212
I made a search engine worse than Elasticsearch (2024)
Integrating my BM25 pandas search library, SearchArray, into BEIR, in order to embarass myself in public.
213
Model Once, Represent Everywhere: UDA (Unified Data Architecture) at Netflix
Introducing UDA, the knowledge-graph-based architecture that translates conceptual domain models into consistent schemas and data…
214
A Python-first data lakehouse
Prototype in Marimo, deploy in Bauplan. Learn how to build production-grade pipelines from notebooks with a Python-native stack. No handoffs, no rewrites.
215
BM25 in PostgreSQL
VectorChord-BM25 enhances PostgreSQL search with BM25 ranking, 3x faster than ElasticSearch. Supports BERT, Tocken, and Unicode tokenizers
216
A new database on police use of force and misconduct in California
UC Berkeley Journalism offers a two-year Master of Journalism (MJ) degree and a summer minor, preparing students for careers in journalism.
217
Losing a 5-year-long Illinois FOIA lawsuit for database schemas
Thomas Ptacek, a friend and expert witness in this lawsuit summed it up best in the court's hallway while walking within three feet of opposing counsel: "This is fucking stupid" .
218
219
Subtleties of SQLite Indexes
Understanding query planner quirks yielded a ~35% speedup.
220
Cursed Excel: "1/2"+1=45660
Explore Excel's bizarre date/time quirks—like “1/2”+1=45660—and how Quadratic fixes legacy issues with a modern approach to datetimes and spreadsheet logic.
221
How exchanges turn order books into distributed logs
Every modern exchange is a distributed database in disguise. This article reveals how trading engines transform chaotic streams of buy and sell orders into a perfectly ordered, replayable log, ensuring fairness, determinism, and market data reliability.
222
Kaggle and the Wikimedia Foundation are partnering on open data
Kaggle is hosting Wikimedia Enterprise's beta release of structured data in both French and English. Kaggle is home to a vast trove of open and accessible data, with mor…
223
Scaling request logging with ClickHouse, Kafka, and Vector
How we solved request logging at scale by moving from MariaDB to ClickHouse, Kafka, and Vector after our deprecated database engine couldn't keep up with billions of monthly requests.
224
$50 PlanetScale Metal Is GA for Postgres
We've lowered the entry price for using PlanetScale Metal to $50 and added more flexibility in storage-to-compute ratios.
225
Build your own SQLite, Part 4: reading tables metadata
As we saw in the opening post, SQLite stores metadata about tables in a special "schema table" starting on page 1. We've been reading records from this…
226
Loading Pydantic models from JSON without running out of memory
Pydantic’s JSON loading uses a huge amount of memory; here’s how to reduce it.
227
Just make it scale: An Aurora DSQL story
AWS Senior Principal Engineers, Niko Matsakis and Marc Bowes, take us inside Aurora DSQL's development: scaling write operations without two-phase commit, overcoming garbage collection hurdles, and embracing Rust for both data and control planes.
228
Kafka at the low end: how bad can it get?
There is oft-quoted advice that Kafka does poorly as a job queue. I’ve experienced this myself, and I wanted to formalize it a bit.
229
Decomposing Transactional Systems
Every transactional system must execute, order, validate, and persist transactions.
230
231
Time Series Forecasting with Graph Transformers
Introduction to Kumo Relational — the relational foundation model for predictive AI on relational data
232
Observability 2.0 and the Database for It
What Observability 2.0 means in practice, how wide events replace siloed metrics/logs/traces, and why GreptimeDB is purpose-built as the database foundation.
233
234
Optimizing Datalog for the GPU
Datalog primer and a neat data structure
235
My Browser WASM't Prepared for This. Using DuckDB, Apache Arrow and Web Workers
by Przemyslaw Maciolek
236
A year of Rust in ClickHouse
This story is about how ClickHouse supports Rust components in the C++ code base and the challenges we had to overcome.
237
UUIDv7 Comes to PostgreSQL 18
PostgreSQL 18 adds native support for UUIDv7. A timestamp-based UUID variant that plays nicely with btree indexes. Here's what that means for you.
238
What’s New in PostgreSQL 18 – a Developer’s Perspective
PostgreSQL 18 features that change how application developers write and ship code.
239
Putting Andrew Ng's OCR models to the test
Testing Andrew Ng's document extraction service reveals over 50% hallucinated values in financial tables. | Pulse AI
240
