New
The latest blog posts to take off on Hacker News. 314 posts.
GPT-3 vs. 3M free-text trivia responses
A machine learning AI-esque robot challenges off on 156 trivia questions against tens of thousands of Water Cooler Trivia participants.
What's New in SQLite 3.35
Math functions, column removal and RETURNING clause.
Investigating how the New York Times A/B tests their headlines
Part 1 of a series on the New York Times, in which I take a close look at how (and when) the New York Times tests multiple headlines for a single article.
I don't want to learn your query language (2018)
This is a bit of a rant but I really don't like software that invents its own query language. There's a trillion different ORMs out there. Another trillion databases with their own query language. Another trillion SaaS products where the only way to query is to learn some random query DSL they made up.
Internet Archive Scholar: Search Millions of Research Papers
Looking for a research paper but can’t find a copy in your library’s catalog or popular search engines? Give Internet Archive Scholar a try! We might have a PDF from a “vanished” Open Access publisher in our web archive, an author’s pre-publication manuscript from their archived faculty webpage, or a digitized…
Excel Never Dies
The Spreadsheet That Launched A Million Companies
Citus 10 brings columnar compression to Postgres
Deep dive into Citus columnar storage for Postgres. Includes a quickstart, as well as performance measurements for data loading, compression ratios, and query response times. Also covers how columnar relates to Citus, integration with Postgres range partitioning, limitations, & ways to get started.
Cleaning Up Your Postgres Database
Actionable steps on how to improve your Postgres database performance.
Modern Text Features in R
ragg has taken a major leap forward in text-rendering capabilities with the latest releases of systemfonts, textshaping, and ragg itself. This post will go into detail with what is now possible and how it compares to the build in devices.
Tips for Shipping Data Products Fast
Shipping a new data-centric product is hard, and under tight time constraints it's even harder. Here are 4 tips that are proven to help you ship new products fast.
ClickHouse as an alternative to Elasticsearch for log storage and analysis
In 2018, I've written an article about Clickhouse, this piece of content is still pretty popular across the internet, and even was translated a few times. More than two years have passed since, and the pace of Clickhouse development is not slowing down: 800 merged PRs just during last month!
An Introduction to Hierarchical Modeling
A visual explanation of multi-level modeling
Introducing dbt + Materialize
Efficient SQL data transformations & real-time analytics with dbt + Materialize: a powerful operational data warehouse combo.
Fuzzy Name Matching in Postgres
The page "Falsehoods Programmers Believe About Names" covers some of the ways names are hard to deal with in programming. This post will ignore most of those complexities, and deal with the problem of matching up loose user input to a database of names.
A Data Pipeline Is a Materialized View
Say you run an online book store and want to build a data pipeline that figures out who the top-selling authors are. Logically, the input to the pipeline is a log of every individual book purchase on the store for all time, along with details about each book like who authored it. And the output is a list of the…
Cross-Database Queries in SQLite
I released Datasette 0.55 and sqlite-utils 3.6 this week with a common theme across both releases: supporting cross-database joins. Cross-database queries in Datasette SQLite databases are single files on disk. …
How ClickHouse saved our data (2020)
The Mux Data platform is used by some of the biggest broadcasters to monitor the video streaming experience of their end users. Think of it like Google Analytics or New Relic for video playback. It's a...
OpenZFS – dRAID, Finally
Learn about dRAID in OpenZFS 2.1. Explore its data protection capabilities, distributed hot spares, faster resilvering, and enhanced performance in this article.
The Database Inside Your Codebase
Navigating codebases of any meaningful size is difficult. Most of a programmer's time is spent jumping through the codebase, reading or skimming to build a ment...
Many small queries are efficient in SQLite
200 SQL statements per webpage is excessive for client/server database engines like MySQL, PostgreSQL, or SQL Server.
US Presidential Election $25k Database Bounty Review
Blog for DoltHub, a website hosting databases made with Dolt, an open-source version-controlled SQL database with Git-like semantics.
Why SELECT * is bad for SQL performance (2020)
Here’s a list of reasons why SELECT * is bad for SQL performance, assuming that your application doesn’t actually need all the columns. When I write production code, I explicitly specify the columns of interest in the select-list (projection), not only for performance reasons, but also for application reliability…
AWS Babelfish: The Elephant in the PostgreSQL Room?
Fundación PostgreSQL
Spotify Optimized the Largest Dataflow Job Ever for Wrapped 2020
In this post we’ll discuss how Spotify optimized and sped up elements from our largest Dataflow job, , for using a technique called Sort Merge Bucket (SMB) join. We’ll present the design and implementation of SMB and how we incorporated it into our data pipelines.