Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
Parsing the Infamous Japanese Postal CSV
Late last year I released posuto, a package presenting Japanese postal code data in an easy-to-use format. It's based on data released by Japan Post, which is infamous for being widely used but hard to parse.
A data analysis of speeches at the Oscars
I analysed almost 2,000 Oscar speeches to discover if the claim that Harvey Weinstein was thanked more often than God is true. Plus, we'll find out which Hollywood icon is bigger than both of them.
APFS changes in Big Sur: how Time Machine backs up to APFS
APFS adds 6 volume roles, including one which supports Time Machine backups. And per-file encryption is coming.
Advantages of Using R Notebooks for Data Analysis Instead of Jupyter Notebooks
The relatively new R Notebooks improve the workflows of common data analysis in ways Jupyter Notebooks can’t.
Charting Form Ds to roughly see the state of venture capital “fund” raising
Above is a graph that displays the amount of Form Ds filed, where the entity (read: company/firm) name contains the phrases "fund I", "fund II", "fund III", and "fund IV". The x-axis is not the prettiest, but it is broken down by quarter. You can see that the line for "fund I" sees by far the greatest peak around…
Bloom Filters by example
A Bloom filter is a data structure designed to tell you, rapidly and memory-efficiently, whether an element is present in a set.
The Incredible Power of the Amazon EC2 Cluster GPU Instances
Today Amazon Web Services takes another step on the continuous innovation path by announcing a new Amazon EC2 instance type: The Cluster GPU Instance. Based on the Cluster Compute instance type, the Cluster GPU instance adds two NVIDIA Telsa M2050 GPUs offering GPU-based computational power of over one TeraFLOPS per…
AI for Data Journalism: demonstrating what we can do with this stuff
I gave a talk last month at the Story Discovery at Scale data journalism conference hosted at Stanford by Big Local News. My brief was to go deep into the …
Rust DataBase Connectivity (RDBC)
Software engineer specializing in query engines and distributed systems
How Is Data Stored?
Invariably, it involves trying to trap electrons in increasingly complicated ways.
Jepsen: RethinkDB 2.2.3 reconfiguration
In the previous Jepsen analysis of RethinkDB , we tested single-document reads, writes, and conditional writes, under network partitions and process pauses. RethinkDB did not exhibit any nonlinearizable histories in those tests. However, testing with more aggressive failure modes, on both 2.1.5 and 2.2.3, has…
I analyzed the lineups at the most popular nightclubs
A few years back I did a bit of dance music related data visualization over at Lazily Evaluated. My favourite was an analysis of clubs and their lineups using Resident Advisor / RA data, I called it Clubster Analysis. I always wanted to dig into the technical aspects of gathering the data, analyzing it and building…
Postgres full-text search is Good Enough (2015)
When you have to build a web application, you are often asked to add search. The magnifying glass is something that we now add to wireframes without even knowing what we are going to search.
We are building data breach machines and nobody cares
A few weeks ago, my longstanding friend and colleague Curt Cunning mentioned to me that he was slogging through Nietzsche, which bespeaks his incredible will to power through things that are unpleasant (one of the many things that makes him an exceptional engineer). In any case, it lead me to revisit some of his work…
Google’s S2, geometry on the sphere, cells and Hilbert curve
Update - 05 Dec 2017: Google just announced that it will be commited to the development of a new released version of the S2 library, amazing news, repository can be found here. Google's S2 library is a real treasure, not only due to its capabilities for spatial indexing but also because it is a library that
Does anyone run Postgres without PgBouncer?
Almost every notable managed Postgres provider bundles a connection pooler, giving us a strong hint that connection management is a product problem rather than a user problem.
Scalability, but at what cost? (2015)
Michael Isard, Derek Murray, and I recently sent in a HotOS submission (it’s not blind, so no harm talking about it, we think). The subject is hinted at from...