Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
Stream and Go: News feeds for 300M users, built on RocksDB and Raft
Discover the tech stack used by Stream. Explore 42 tools across 5 categories.
Loro's rich text CRDT
This article presents the rich text CRDT algorithm implemented in Loro, complying with Peritext's criteria for seamless rich text collaboration. Furthermore, it can be built on top of any List CRDT algorithms and turn them into rich text CRDTs.
Full-Text Search with DuckDB
Pete Doherty is a NYC based software developer
Looking for Voter Fraud (In Old Elections) with Data Visualization
The 2020 US election is finally over, and all the election excitement of the last week reminded me of something I had been meaning to look into: Sergey Shpilkin’s data visualizations that cle…
Reddit’s database has two tables (2012)
Steve Huffman talks about Reddit’s approach to data storage in a High Scalability post from 2010. I was surprised to learn that they only have two tables in their database.
How PlanetScale Boost serves SQL queries faster
PlanetScale offers the world’s fastest and most scalable cloud hosting for Vitess, Neki, and Postgres.
Data Science of the Facebook World
Stephen Wolfram shares interesting Facebook data analysis finds from the Data Donor program of Wolfram|Alpha Personal Analytics for Facebook.
World Cup Follow-Up: Update of Winning Probabilities and Betting Results
An update on the winning probabilities for the remaining World Cup teams, and an analysis of how our predictor performed on the group-phase matches.
The new PostgreSQL 17 make dist
When the PostgreSQL project makes a release, the primary artifact of that is the publication of a source code tarball. That represents the output of all the work that went into the creation of the PostgreSQL software up to the point of the release. The source tarball is then used downstream by packagers to make binary…
CRDT-richtext: Rust implementation of Peritext and Fugue
Made in Notion, the connected workspace where AI agents and teams organize docs, projects and knowledge together.
The two versions of Parquet
The adoption of Parquet version 2 is limited due to the lack of support in the ecosystem, which affects its evolution despite its improvements in compression and performance.
Datomic: Event Sourcing without the hassle
When I got started using the Datomic database, I remember someone describing it to me as 'Event Sourcing without the hassle'. Having built Event Sourcing systems both with and without Datomic, I think this is very well put, although it might not be obvious, especially if you don't have much experience with Datomic.
Why we moved from AWS RDS to Postgres in Kubernetes
Every new Nhost project now gets a dedicated PostgreSQL instance on Kubernetes with root access, custom extensions, and direct connections.
InfluxDB is betting on Rust and Apache Arrow for next-gen data store
InfluxData Founder & CTO Paul Dix lays out a vision for the future of InfluxDB and introduces a new project that will form its basis: InfluxDB IOx.
Async I/O on Linux in databases
I've been working on a complex multi-model database for a few weeks now, and recently I took time to simplify and test out an idea I had on a simple key-value database. I started with the basics: A hash table in memory, a simple append-only log
Truth First, or Why You Should Mostly Implement Database-First Designs
In this much overdue article, I will explain why I think that in almost all cases, you should implement a “database first” design in your application’s data models, rather than a …
1.1B Taxi Rides Using OmniSciDB and a MacBook Pro
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
Optimizing Large-Scale OpenStreetMap Data with SQLite
The personal website of JT Archie. Includes a blog, work ethic, and projects they have worked on.
Retool Database
Get a free Postgres DB with the speed + convenience of a spreadsheet. No setup required. Get started today.
On Sharding
If you need to handle really a lot of traffic, there’s only one way to do it: sharding. Which is to say, splitting up the incoming requests among as many hosts (or Lambda functions, or message brokers, or data streams) as you need. Once you get this working you can handle an essentially unlimited request volume. Of…
Building a BFT JSON CRDT
CRDTs are a family of data structures that are designed to be replicated across multiple computers without needing to worry about conflicts when people write data to the same place.
How we index images for RAG
Reading the screenshots, diagrams and tables in technical documentation for LLMs
OpenTelemetry profiles enters public alpha
Since OpenTelemetry first introduced Profiles, momentum has only grown towards building a unified industry standard for continuous production profiling, standing alongside traces, metrics, and logs. Today, the Profiling SIG is proud to announce that the Profiles signal has officially entered public Alpha, and we are…
Elasticsearch from the Bottom Up (2013)
In this article series, we look at Elasticsearch from a new perspective. We'll start at the 'bottom' (or close enough!) of the many abstraction levels, and gradually move upwards towards the user-visi...
PostgreSQL: Kubegres is available as open source
[Kubegres](https://www.kubegres.io) is an open-source Kubernetes operator allowing to deploy a cluster of PostgreSql instances with data replication enabled out-of-the box. …