New
The latest blog posts to take off on Hacker News. 1,888 posts.
Datasette Lite: a server-side Python web application running in a browser
Datasette Lite is a new way to run Datasette: entirely in a browser, taking advantage of the incredible Pyodide project which provides Python compiled to WebAssembly plus a whole suite …
Simple declarative schema migration for SQLite
At my company we use a small SQLite database. We define the schema in a single file with SQL CREATE TABLE statements. If we add tables, columns, or indexes, our application will create them automatically the next time it starts up.
Why isn’t there a decent file format for tabular data?
Tabular data is everywhere. I support reading and writing tabular data in various formats in all 3 of my software application. It is an important part of my data transformation software. But all th…
I put my whole life into a single database
Back in 2019, I started collecting all kinds of metrics about my life. Every single day for the last 2.5 years I tracked over 100 different data types - ranging from fitness & nutrition to social life, computer usage and weather.
The satellite imagery industry still has no idea what customers want
The satellite imagery industry still has no idea what customers actually want
A basic introduction to NumPy's einsum
Haphazard investigations
MySQL now shows its thread names at OS level for better troubleshooting
Starting from v8.0.27, the MySQL daemon shows its thread names at the OS level too, for better troubleshooting. The MySQL 8.0.27 release notes say this: To assist monitoring and troubleshooting, the Performance Schema instrumentation is now used to export names of instrumented threads to the operating system. This…
Filesystems can experience at least three different sorts of errors
You're probably reading this page because you've attempted to access some part of my blog (Wandering Thoughts) or CSpace , the wiki thing it's part of. Unfortunately you're using a browser version that my anti-crawler precautions consider suspicious, most often because it's too old (most often this applies to versions…
FoundationDB: A distributed unbundled transactional key value store
This paper from Sigmod 2021 presents FoundationDB, a transactional key-value store that supports multi-key strictly serializable transacti...
Phases of Netflix’s real-time data infrastructure
The blog post will share the four phases of Real-time Data Infrastructure’s iterative journey in Netflix (2015-2021). For each phase, we will go over the evolving business motivations, the team’s unique challenges, the strategy bets, and the use case patterns we discovered along the way.
How can we know if paid search advertising works?
Addressing causal problems on major eBay and Facebook
Non blocking and zero downtime ALTER statements in PostgreSQL with pg-osc
pg-osc is a CLI tool for making non-blocking, zero downtime schema changes in PostgreSQL
New JSON query operators in SQLite 3.38.0
SQLite 3.38.0 introduced improvements to JSON query syntax using -> and ->> operators that are similar to PostgreSQL JSON functions. In this post we...
Optimizing Postgres text search with trigrams
In this post, we’ll implement and optimize a text search system based on Postgres Trigrams
Squeezing Performance from SQLite: EXPLAINing the Virtual Machine
The virtual machine? Yep, but not the Java Virtual Machine.
Static B-Trees: A data structure for faster binary search
This section is a follow-up to the previous one , where we optimized binary search by the means of removing branching and improving the memory layout. Here, we will also be searching in sorted arrays, but this time we are not limited to fetching and comparing only one element at a time.
I used Benford’s law to analyze Covid-19 in 113 countries (2020)
Spoiler alert: I found some intriguing patterns…
A Hairy PostgreSQL Incident
It was 5:17pm today, just as I was wrapping up work for the day, and my manager pinged me with the following chat: <manager>: Hi Jeremy – we have a <other team> ticket – esc…
How PostgreSQL stores rows
poking inside postgres pages
The Plausibly Deniable DataBase (PDDB)
The problem with building a device that is good at keeping secrets is that it turns users into the weakest link.
Read “Data and Reality”
Once more: we are not modeling reality, but the way information about reality is processed, by people. — Bill Kent I've got this working theory that you can...
Where in the world are Trader Joe’s warehouses? (2015)
Personal website of Samuel Burer, Tippie Rollins Professor of Business Analytics, University of Iowa.