Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
R Passes SAS in Scholarly Use
Relative market share of R, SAS, SPSS, Stata, Spark, H2O, and other data science tools
Preview of Explore Logs, a new way to browse your logs without writing LogQL
Learn all about Explore Logs, a new way to browse your logs in Grafana 11 and Loki 3.0 without writing LogQL.
Representing Graphs in PostgreSQL
Some tricks and techniques for working with graph or tree like data in Postgresql
Manticore 6.0.0 – a faster alternative to Elasticsearch in C++
Today, the Manticore team is thrilled to announce the release of Manticore Search 6.
Pokémon Team Optimization
This article will show you how forming your Pokémon team can be turned into a mathematical optimization problem.
Jepsen: Redpanda 21.10.1
Redpanda is a Kafka -compatible distributed streaming system based around append-only logs. Compared to Kafka, Redpanda aims to offer users lower latencies and reduced operational complexity. It uses the Raft consensus algorithm internally, rather than depending on a separate installation of Zookeeper . Redpanda…
Move Fast and Migrate Things: How We Automated Migrations in Postgres
At Benchling, we’re building a platform to help scientists do research. Hundreds of thousands of scientists across academia and enterprise…
The growing pains of database architecture
How the Figma infrastructure team reduced potential instability by scaling to multiple databases
Making Google Data Studio Free for Everyone
Today, Google's mission to organize the world's information and make it universally accessible and useful is even more relevant and broad reaching.
What I talk about when I talk about query optimizer (part 1): IR design
Achieving Data Freedom Through Open Source and Rust
Lessons learned from building a sync-engine and reactivity system with SQLite
Welcome to my personal blog! I use it to share what I'm currently learning or thinking about, usually on topics related to technology, business, and health.
Data Compression Explained (2012)
Copyright (C) 2010-2012, Dell, Inc . You are permitted to copy and distribute material from this book provided (1) any material you distribute includes this license, (2) the material is not modified, and (3) you do not charge a fee or require any other considerations for copies or for any works that incorporate…
Replacing a 3 GB SQLite db with a 10 MB FST (finite state transducer) binary
Note for numberphiles: all numbers have been rounded to their first significant digit, because I’m a fan of Rob Eastaway’s “zequals” method of getting to the point when it comes to estimation. It’s much more valuable to walk away with the heuristic “some dude got a 300x memory reduction by swapping out a database he…
Harvard discrimination lawsuit: data show penalization of Asian-Americans
Harvard and Students For Fair Admissions (SFFA), which is suing Harvard over discrimination against Asian-American applicants, have relea...
Are You Sure You Want to Use MMAP in Your Database Management System? (2022)
MMAP Databases = 💩
Deep dive into Turso, the “SQLite rewrite in Rust”
I love Rust and I love SQLite, so you can guess. Iwas pretty excited when I lerned that "SQLite was rewritten in Rust" What is SQLite, actually? 2 things: a
The Rise of SQL-Based Data Modeling
The resurgence of SQL-based data modeling is a something we should all be interested in. Here's why it's important.
A glitch in an online survey replaced the word 'yes' with 'forks'
Dating back to at least early 2023, a bizarre and alarming technical glitch started popping up in some organizations’ online surveys and forms.
Turning the database inside-out (2015)
Databases are global, shared, mutable state. That’s the way it has been since the 1960s, and no amount of NoSQL has changed that. However, most self-respecting developers have got rid of mutable global variables in their code long ago. So why do we tolerate databases as they are?
Does Postgres Scale?
Benchmarking the workflow execution and workflow queueing scalability of a single Postgres server.
Updates to the H2O.ai db-benchmark
The H2O.ai db-benchmark has been updated with new results. In addition, the AWS EC2 instance used for benchmarking has been changed to a c6id.metal for improved repeatability and fairness across libraries. DuckDB is the fastest library for both join and group by queries at almost every data size.
Elasticsearch 6.0.0 GA released
With 2236 pull requests by 333 commiters added since the release of Elasticsearch 5.0.0, we are proud to announce the release of Elasticsearch 6.0.0 GA, based on Lucene 7.0.1.
Migrating 23TB from S3 to B2 in 7 hours
Nodecraft moved 23TB of customer backup files from AWS S3 to Backblaze B2 in just 7 hours, and saved big on egrees fees with Cloudflare's Bandwidth Alliance.
The magic of small databases
Notes on personal libraries, collections and small indexes on the web
PyPy's New JSON Parser
Introduction In the last year or two I have worked on and off on making PyPy's JSON faster, particularly when parsing large JSON files. I...
Is Postgres read heavy or write heavy?
A query to find out if Postgres is read heavy or write heavy and tips for optimizing Postgres for both read and write workloads.
SQLite is easy to compile
SQLite is really easy to compile