Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
A data analysis of speeches at the Oscars
I analysed almost 2,000 Oscar speeches to discover if the claim that Harvey Weinstein was thanked more often than God is true. Plus, we'll find out which Hollywood icon is bigger than both of them.
Anatomy of a SQL Engine
Blog for DoltHub, a website hosting databases made with Dolt, an open-source version-controlled SQL database with Git-like semantics.
APFS changes in Big Sur: how Time Machine backs up to APFS
APFS adds 6 volume roles, including one which supports Time Machine backups. And per-file encryption is coming.
The evolution of the data engineer role
The Evolution of The Data Engineer: A Look at The Past, Present & Future
Advantages of Using R Notebooks for Data Analysis Instead of Jupyter Notebooks
The relatively new R Notebooks improve the workflows of common data analysis in ways Jupyter Notebooks can’t.
Meta quickly detects silent data corruptions at scale
Silent data corruptions (SDCs), data errors that go undetected by the larger system, are a widespread problem for large-scale infrastructure systems. Left undetected, these types of corruptions can…
Charting Form Ds to roughly see the state of venture capital “fund” raising
Above is a graph that displays the amount of Form Ds filed, where the entity (read: company/firm) name contains the phrases "fund I", "fund II", "fund III", and "fund IV". The x-axis is not the prettiest, but it is broken down by quarter. You can see that the line for "fund I" sees by far the greatest peak around…
RethinkDB 1.7: hot backup, atomic set/get, 10x insert performance improvement
Etienne Laurin ( @atnnn ), an engineer at RethinkDB, introduces these new features in this one-minute video:
Bloom Filters by example
A Bloom filter is a data structure designed to tell you, rapidly and memory-efficiently, whether an element is present in a set.
Experiences with running PostgreSQL on Kubernetes
An interview covering our experience running PostgreSQL on on-premises Kubernetes: challenges, open source and commercial tools, and alternatives for stateful apps.
Building a Streaming Platform in Go for Postgres
At PeerDB, our mission is to create a Postgres-first data-movement platform that makes it fast and simple to stream data from Postgres to Data Warehouses…
The Incredible Power of the Amazon EC2 Cluster GPU Instances
Today Amazon Web Services takes another step on the continuous innovation path by announcing a new Amazon EC2 instance type: The Cluster GPU Instance. Based on the Cluster Compute instance type, the Cluster GPU instance adds two NVIDIA Telsa M2050 GPUs offering GPU-based computational power of over one TeraFLOPS per…
AI for Data Journalism: demonstrating what we can do with this stuff
I gave a talk last month at the Story Discovery at Scale data journalism conference hosted at Stanford by Big Local News. My brief was to go deep into the …
IOx: InfluxData’s New Storage Engine
Today I’m excited to announce that we deployed our next-generation storage engine that’s built on InfluxDB IOx in our InfluxDB Cloud platform. #influxdb
Extracting Structured Data from Recipes Using Conditional Random Fields (2015)
Erica Greene describes the tool that she built to extract structured data from recipes.
Rust DataBase Connectivity (RDBC)
Software engineer specializing in query engines and distributed systems
How Is Data Stored?
Invariably, it involves trying to trap electrons in increasingly complicated ways.
Jepsen: RethinkDB 2.2.3 reconfiguration
In the previous Jepsen analysis of RethinkDB , we tested single-document reads, writes, and conditional writes, under network partitions and process pauses. RethinkDB did not exhibit any nonlinearizable histories in those tests. However, testing with more aggressive failure modes, on both 2.1.5 and 2.2.3, has…
DBOS: A database-oriented operating system
Today, most people develop applications on operating systems such as Linux which are more than thirty years old, even though computing has changed a lot in the meantime. Since Linux was first released in 1991, the size of application state and data has grown by several orders of magnitude, many applications have moved…
I analyzed the lineups at the most popular nightclubs
A few years back I did a bit of dance music related data visualization over at Lazily Evaluated. My favourite was an analysis of clubs and their lineups using Resident Advisor / RA data, I called it Clubster Analysis. I always wanted to dig into the technical aspects of gathering the data, analyzing it and building…