1471
Scaling a High-Traffic Rate Limiting Stack with Redis Cluster
Flattening a single very hot vertical Redis node into a horizontal Redis Cluster at Stripe.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
1472
Think Stats: Probability and Statistics for Programmers
This HTML version of is provided for convenience, but it is not the best format for the book. In particular, some of the symbols are not rendered correctly.
1473
1474
ChatGPT is now finding bugs in databases
Engineering notes and product news from the PhoenixAI team — real-time analytics, AI agent workloads, lakehouse architecture, and what we're shipping.
1475
There is no data engineering roadmap
Data Engineering is booming and many are looking for a cheat sheet to get started. Do you really need to learn 200 tools before you get your first job?
1476
RethinkDB 1.5 released: secondary indexes, soft durability, perf improvements
We are pleased to announce RethinkDB 1.5 ( The Graduate), so go download it now !
1477
Retrieval in LangChain
Build better AI apps with flexible retrieval methods in LangChain. Use any retriever—from semantic to hybrid—to create personalized ChatGPT for your data.
1478
Arch Linux: MariaDB replaces MySQL in repositories
MariaDB is now officially our default implementation of MySQL. MariaDB is almost a drop in replacement, so an upgrade should be possible with minimum hassle. However, due to remaining compatibility concerns, an automatic replace is not done.
1479
TrailDB – An Efficient Library for Storing and Processing Event Data
Today, we are open-sourcing TrailDB, a core library powering AdRoll. TrailDB makes it fast and fun to handle event data.
1480
1481
Amazon Aurora: Avoiding Distributed Consensus for I/Os, Commits, Membership
Amazon Aurora: on avoiding distributed consensus for I/Os, commits, and membership changes, Verbitski et al., SIGMOD’18 This is a follow-up to the paper we looked at earlier this week on the design…
1482
Saving cloud costs by writing our own database
What is the first rule of programming? Maybe something like “do not repeat yourself” or “if it works, don’t touch it”? Or, how about “do not write your own database!”… That’s a good one.
1483
The largest city in each 10x10 degree latitude/longitude box
From the highly eclectic blog of Mark Dominus
1484
The Rise and Fall of the OLAP Cube (2020)
A definitive history of the rise of the OLAP cube, how it's affected our industry, and what comes after.
1485
Heroku Postgres is now based on AWS Aurora
We’re thrilled to launch our new Heroku Postgres Essential database plans. These plans have pgvector support, no row count limits, and come with a 32 GB...
1486
The Big Data Brain Drain: Why Science is in Trouble
Update, August 2014: see Hacking Academia , my most recent reflection on this subject.
1487
1488
1489
How Compaction Works in Pi
Why compaction is needed for large language models and how Pi implements it
1490
1491
Comprehensive Guide on Data Visualization with Pandas
Visualization has always been challenging task but with the advent of dataframe plot() function it is quite easy to create decent looking plots with your dataframe, The **plot** method on Series and DataFrame is just a simple wrapper around Matplotlib plt.plot() and you really don’t have to write those long matplotlib…
1492
PostgreSQL, Memory and the Cloud
This post explains how Linux memory overcommit and OOM-killer behavior can turn a single runaway query into a full PostgreSQL crash, and why many managed cloud database services fail to disable overcommit the way self-hosted PostgreSQL recommends.
1493
1494
1495
The implementation of the UK Covid-19 dashboard
Why and how the UK Coronavirus Dashboard team built their analytics service on top of PostgreSQL & Citus on Azure.
1496
1497
ScyllaDB Open Source 3.0
With the release of ScyllaDB Open Source 3.0, we’ve introduced a rich set of new production-ready features that surpass the capabilities of Apache Cassandra.
1498
SimpleDB: A Basic RDBMS Built from Scratch
My databases class at UCLA wasn’t very challenging so I never truly understood the internals of databases. This always bothered me so I vowed to build a simple database from scratch to learn the fundamentals. MIT's Database Systems course has their students implement a simple database from scratch and it provided me…
1499
Audio Fingerprinting with Python and Numpy (2013)
Personal Blog of Will Drevo
1500
A Technical Dive into PostgreSQL's replication mechanisms
Guide to PostgreSQL Replication and CDC - Navigate the complexities of logical replication in PostgreSQL.