121
MinIO: A Bare Metal Drop-In for AWS S3
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
New
The latest blog posts to take off on Hacker News. 314 posts.
122
The Problem with Perceptual Hashes
Apple just announced that they will use “perceptual hashing” to detect illegal photos on iPhones. I have some experience to share on this technology.
123
How PostgreSQL aggregation works and how it inspired our hyperfunctions’ design
A discussion of aggregation in PostgreSQL and how it integrates with the design of Timescale’s hyperfunctions.
124
125
SQLite Is Dynamically Typed (2020)
A small, cool fact about SQLite is that its columns are flexibly typed. You can store any value in any column! Try it out: sqlite> create table t1 (v1 int, v2 varchar(10)); sqlite> insert into t1 values ("abc", "this string is longer than 10 characters!"); sqlite> select * from t1; abc|this string is longer than 10…
126
Savings are now more liquid and part of “M1 money”
Money is marvelously nuanced. Because different assets can be used as money, we need several categories and definitions to keep track of it. M1 describes the most liquid and widely...
127
128
Faster CRDTs: An Adventure in Optimization
Some researchers in France put together a comparison showing lots of ways you could implement realtime collaborative editing (like Google Docs). They implemented lots of algorithms - CRDTs and OT algorithms and stuff. And they benchmarked them all to see how they perform. (Cool!!) Some algorithms worked reasonably…
129
Hosting SQLite Databases on GitHub Pages
I was writing a tiny website to display statistics of how much sponsored content a Youtube creator has over time when I noticed that I often write a small tool as a website that queries some data from a database and then displays it in a graph, a table, or similar. But if you want to use a
130
131
Let’s Talk OpenZFS Snapshots
Optimize OpenZFS snapshots. Learn which data benefits from snapshots, how long to keep them, and how to avoid performance bottlenecks.
132
Postgres Full-Text Search: A search engine in a database
With Postgres, you don't need to immediately look farther than your own database management system for a full-text search solution. If you haven't yet given Postgres' built-in full-text search a try, read on for a simple intro.
133
Evolution of tree data structures for indexing
I have to admit, my research blog posts are getting longer and longer. From one side I find it genuinely encouraging, because if one gets so much information just by scratching the topic, imagine what’s hidden beneath the surface! One university professor once said “what could be interesting in databases?”, and it…
134
What time-weighted averages are and why you should care
Learn how time-weighted averages are calculated and why they’re so powerful for data analysis. Read the full article on the Tiger Data blog.
135
Inserting 130M SQLite rows per minute from a scripting language
The other week, I stumbled on the post Inserting One Billion Rows in SQLite Under A Minute , which was a funny coincidence, as I was just in...
136
Migrating Facebook to MySQL 8.0
MySQL, an open source database developed by Oracle, powers some of Facebook’s most important workloads. We actively develop new features in MySQL to support our evolving requirements. These feature…
137
Latest Data on COVID-19 Vaccinations by Race/Ethnicity
KFF is collecting and analyzing data on COVID-19 vaccinations by race/ethnicity to gain increased insight who is receiving the vaccine and whether some groups are facing disparities in vaccination.
138
Inserting a billion rows in SQLite under a minute
This is a chronicle of my experiment where I set out to insert 1B rows in SQLite
139
140
Last Mile Redis
Documentation and guides from the team at Fly.io.
141
Generating JSON Directly from Postgres
PostgreSQL has built-in JSON generators that can be used to create structured JSON output right in the database, upping performance and radically simplifying web tiers.
142
Postgres sequences can skip 32 unexpectedly
The other day, we started getting strange reports from some customers of incident.io. Their incident identifiers — unique numbers to identify each incident — appeared to have jumped unexpectedly.
143
RabbitMQ Streams Overview
RabbitMQ 3.9 introduces a new type of data structure: streams. Streams unlock a set of use cases that could have been tedious to implement with "traditional" queues. Let's discover in this post how streams expand the capabilities of RabbitMQ.
144
OpenSearch 1.0
Today is a really good day for the OpenSearch project. Since its start, the goal has been to quickly produce a version of OpenSearch that’s ready to use in production...
145
Why do we use R rather than Excel?
I recently had cause to take a beginners course in R - a language I'm fairly familiar with. One of the other students had never used it before, so we were buddied up in order for me to show them the ropes. The first lesson of R is always the same. Read a CSV, manipulate it a bit, draw a graph. We did it all without…
146
PostgreSQL, Memory and the Cloud
This post explains how Linux memory overcommit and OOM-killer behavior can turn a single runaway query into a full PostgreSQL crash, and why many managed cloud database services fail to disable overcommit the way self-hosted PostgreSQL recommends.
147
Ribbon filter: Practically smaller than Bloom and Xor
What the research is: The Ribbon filter is a new data structure that is more space-efficient than the popular Bloom filters that are widely used for optimizing data retrieval. One of the ways that …
148
Against SQL
But SQL is the only widely-used implementation of the relational model, and it is:
149
Building a data team at a mid-stage startup
You are brought into a startup to run their three-person data team. This is a story about teams and organization, and how you spend a year getting the team to a good place.
150
