121
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
122
The One Billion Row Challenge
Update Jan 4: Wow, this thing really took off! 1BRC is discussed at a couple of places on the internet, including Hacker News, lobste.rs, and Reddit. For folks to show-case non-Java solutions, there …
123
How Does Sqlite Work? (2014)
How does SQLite work? Part 1: pages!
124
The internals of PostgreSQL
After a temporary stay in Japan to focus on my health and personal responsibilities, I am fully recovered, ready, and excited to work abroad again.
125
Recently minted database technologies that I find intriguing
I’m a huge fan of databases, so much so that I’ve written a book on so-called “NoSQL” databases, I spent some of my most fruitful years in tech working on the highly influential distributed database Riak , and I even built a database called Purple last year just for fun.
126
A Minimalist Guide to SQLite
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
127
Which jobs most often pair together among married couples
Find out which jobs most often pair together among married couples.
128
Cosmologically Unique IDs
We are an exploratory species, just past the solar system now, but perhaps one day we will look back and call our galaxy merely the first. There are many problems to solve along the way, and today we will look at one very small one. How do we assign IDs to devices (or any object) so the IDs are guaranteed to always be…
129
NumPy Exercises for Data Analysis in Python
The goal of the numpy exercises is to serve as a reference as well as to get you to apply numpy beyond the basics. The questions are of 4 levels of difficulties with L1 being the easiest to L4 being the hardest.
130
Command-line tools can be faster than a Hadoop cluster (2014)
Adam Drake is an advisor to scale-up tech companies. He writes about ML/AI/data, leadership, and building tech teams.
131
Data Science: Reality Doesn't Meet Expectations
OLXTOTO adalah situs menyediakan link alternatif untuk login tanpa hambatan yang di rancang agar pemain bermain lebih stabil dan optimal apabila domain utama mengalamin kendala. Nike Hat Size 6 1/2 6 5/8 6 3/4 6 7/8 7 7 1/8 7 1/4 7 3/8 7 1/2 7 5/8 7 3/4 Head Size (CM) 52 53 54 55 56 57 58 59 60 61 62 Alpha Size - - XS…
132
Make the “semantic web” web 3.0 again – with the help of SQLite
Before the term was hijacked by crypto-grifters (and, admittedly, a few genuinely neat projects), web 3 (point oh) referred to Tim Berners-Lee's project to promote a standard way to expose and parse metadata on the web. It never took off. In this piece, I'll argue that a breakthrough idea introduced last year by HN…
133
Xor Filters: Faster and Smaller Than Bloom Filters
In software, you frequently need to check whether some objects is in a set. For example, you might have a list of forbidden Web addresses. As someone enters a new Web address, you may want to check whether it is part of your black list. Or maybe you have a large list of already used … Continue reading Xor Filters…
134
Using Metadata to Find Paul Revere
London, 1772. I have been asked by my superiors to give a brief demonstration of the surprising effectiveness of even the simplest techniques of the new-fangled Social Networke Analysis in the pursuit of those who would seek to undermine the liberty enjoyed by His Majesty’s subjects. This is in connection with the…
135
Redis explained
A deep technical dive into all things Redis. Covering various Redis topologies, data persistence and process forking.
136
Mini NASes marry NVMe to Intel's efficient chip
I'm in the process of rebuilding my homelab from the ground up, moving from a 24U full-size 4-post rack to a mini rack. One of the most difficult devices to downsize (especially economically) is a NAS. But as my needs have changed, I'm bucking the trend of all datahoarders and I need less storage than the 120 TB (80…
137
OpenZFS deduplication is good now and you shouldn't use it
OpenZFS 2.3.0 will be released any day now, and it includes the new “Fast Dedup” feature. My team at Klara spent many months in 2023 and 2024 working on it, and we reckon it’s pretty good, a huge step up from the old dedup as well as being a solid base for further improvements. I’ve been watching various forums and…
138
139
PostgreSQL for Everything
You need simplicity if you want to move fast. PostgreSQL can very well replace Kafka, Redis, Clickhouse and Elastic. And many successful companies are doing exactly that. Let's check out how.
140
141
142
Advanced SQL and database books and resources
For people who've worked through Mastery with SQL , a common question I get is "What's next?" If you completed the course and all 150+ exercises, at this point you'll have a very strong grasp of SQL and should be comfortable writing all sorts of complex queries. However, there's more to working with databases…
143
Things I hate about PostgreSQL (2020)
Over the last few years, the software development community’s love affair with the popular open-source relational database has reached a…
144
145
Personal Data Warehouses: Reclaiming Your Data
I gave a talk yesterday about personal data warehouses for GitHub’s OCTO Speaker Series, focusing on my Datasette and Dogsheep projects. The video of the talk is now available, and …
146
SQL Keys in Depth
The internet is full of dogmatic commandments for choosing and using keys in relational databases. At times it verges on a holy war: should you use natural or artificial keys? Auto-incrementing integers, UUIDs?
147
Instant database clones with PostgreSQL 18
Learn how to clone PostgreSQL databases instantly using reflinks. Turn slow template copies into milliseconds with PostgreSQL 18's new file copy options.
148
SQL should be the default choice for data transformation logic
SQL should be the first option considered for new data engineering work. It’s robust, fast, future-proof and testable. With a bit of care, it’s clear and readable.
149
How Google Code Search Worked: Regex Matching with a Trigram Index (2012)
In the summer of 2006, I was lucky enough to be an intern at Google. At the time, Google had an internal tool called gsearch that acted as if it ran grep over all the files in the Google source tree and printed the results. Of course, that implementation would be fairly slow, so what gsearch actually did was talk to a…
150
Unconventional PostgreSQL Optimizations
Creative ideas for speeding up queries in PostgreSQL