Topics /
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
Caveat: Elasticsearch is a multi-purpose, distributed, battle-tested, schema-free, log and document storage engine. We’ll be replacing it with a single-purpose, relational schema, me-tested, and custom nginx access log storage engine. Knowing that, let’s begin. Find this project on Github After building my home…
In the past year and a half, MongoDB has put a good deal of work into improved read safety, enabled by the adoption of their new replication protocol and the WiredTiger storage engine. Dirty reads were addressed in 3.2 by introducing a majority read concern , and stale reads were addressed with the introduction of the…
Preetam "recently" blogged about catena , a time-series metric store. There was another blog post about benchmarking boltdb by a Fog Creek engineer, also looking to write a time series database. This is something of a pattern in the Go community, which already boasts seriesly , InfluxDB , and prometheus ; there are…
We have completely rewritten the string/binary data structure we use in Polars.
A detailed primer on Roaring bitmaps explaining what they are, how they're different from traditional bitmaps, and how they work internally.
NoSQL databases are often compared by various non-functional criteria, such as scalability, performance, and consistency. This aspect of NoSQL is well-studied both in practice and theory because sp…
Acquisition creates world’s first and only hybrid search engine combining Keyword and Vector Search in a single API.
See how PostgreSQL 19 speeds up aggregations by aggregating before joins, with a benchmark showing over 5x faster execution.
This week I published the first alpha release of Datasette 1.0, with a significant new feature: Datasette core now includes a JSON API for creating and dropping tables and inserting, …
A real quarter of UK SME books, 59 transactions, 68 minutes, $2.73 of tokens — and a VAT return within 7 pence of the human-prepared one.
As it turns out, there is no correlation between programming ability and the frequency of Stack Overflow visits.
Throughout much of the 20th century, frequentist statistics dominated the field of statistics and scientific research. Frequentist statistics primarily focus on the analysis of data in terms of probabilities and observed frequencies. Causal inference, on the other hand, involves making inferences about…
Article explaining how to leverage Zig's compile time metaprogramming to build a SQLite wrapper that can type check SQL queries
How Wirewiki's domain-name autocomplete renders suggestions next frame for 99% of keystrokes.
Intel's latest processor generations are pushing the number of cores in a server to unprecedented levels. For analytical databases like ClickHouse, ultra-high core counts represent a huge opportunity and a complex challenge.
Hash tables provide a fast way to maintain a set of keys or map keys to values, even if the keys are objects, like strings. They are such a ubiquitous tool in computer science that even incremental…
What happens when you give a distributed SQL engine a trillion-row dataset? GizmoEdge crushed the Coiled challenge with a 1,000-worker cluster on Azure.
The team I've been working in for the last year or so have had great success using Postgres-as-queue. We've managed to avoid the following:
tl;dr; Redis is 16 times faster at reading these JSON blobs.*
A feature platform that offers observability and management tools, allows ML practitioners to use a variety of data sources, while handling…
I’ve been a heavy user of ElasticSearch for coming up 7 years now. During that time I’ve used it for a few main usecases: A Search Engine, An APM Solution (after NewRelic started being stupidly expensive), a backend for Jaeger, and as a log storage system. In all of those usecases I’ve really pushed ElasticSearch to…
With Ubicloud PostgreSQL, we are releasing an open and managed PostgreSQL, and cutting your cloud database spend by 3x.
MinIO’s repo is officially archived and abandoned. And how AI Agents helped bring it back from the dead. This post explains how a community fork restores the admin console and ships binaries via CI/CD pipeline.
2024-11-13 : An earlier version of this report asserted that consumers with auto-commit enabled could lose data by automatically committing offsets returned by the most recent poll. This claim was based in part on Confluent’s documentation , which states:
