New
The latest blog posts to take off on Hacker News. 4,224 posts.
Features I'd Like in PostgreSQL
I’ve put in my fair share of time with PostgreSQL. It has no shortage of functionality and I believe its expansive feature set drove a lot of its growing popularity in the 2010s. As my time with the database has worn on I’ve come up with a handful of features that I wish the database had. Some of these are ideas…
The magic of small databases
Notes on personal libraries, collections and small indexes on the web
Surviving without a superuser in Postgres 16
As I've written about before , a PostgreSQL superuser always has the ability to take over the operating system account in which PostgreSQL i...
How to implement Q&A against your docs with GPT3 embeddings and Datasette
If you’ve spent any time with GPT-3 or ChatGPT, you’ve likely thought about how useful it would be if you could point them at a specific, current collection of text …
Replacing Pandas with Polars
I remember those days, oh so long ago, it seems like another lifetime. I haven’t used Pandas in many a year, decades, or whatever. We’ve all been there, done that. Pandas I mean. I would dare say it’s a rite of passage for most data folk. For those using Python, it’s probably one of the […]
Choosing a Postgres primary key
Turns out the question of which identifier to use as a Primary Key is complicated -- we're going to dive into some of the complexity and inherent trade-offs, and figure things out
AcousticBrainz: Making a hard decision to end the project (2022)
We created AcousticBrainz 7 years ago and started to collect data with the goal of using that data down the road once we had collected enough. We finally got around to doing this recenty, and realised that the data simply isn’t of high enough quality to be useful for much at all.
Short, friendly base32 slugs from timestamps
~4 lines of Go to produce succinct, stable, URL-friendly slugs from timestamps.
Datasette is my data hammer
If you're exploring or publishing data, you should give this open source tool a go.
How does it know I want CSV? – An HTTP trick
Forgotten parts of RFC2616
CTEs as lookup tables
How to use a CTE instead of complicated CASE expressions
Bullshit graph database performance benchmarks
Hey HackerNews, let me just drop my mixtape, checkout my soundcloud and “Death Row” is the label that pays me. How is the Graph Database category supposed to grow when vendors keep spou…
Apache Hudi vs. Delta Lake vs. Apache Iceberg Lakehouse Feature Comparison
A thorough comparison of the Apache Hudi™, Delta Lake, and Apache Iceberg™ data lakehouse projects across features, community, and performance benchmarks. This includes a focus on common use cases such as change data capture (CDC) and data ingestion.
Faster PostgresSQL to BigQuery Transfers
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
We're wasting money by only supporting gzip for raw DNA files
Stylised graphics of money with DNA helix in the foreground.
Demystifying Apache Arrow (2020)
Demystifying Apache Arrow - some observations from a data scientist. Learning more about a tool that can filter and aggregate two billion rows on a laptop in two seconds
Modern Polars: A comparison of the Polars and Pandas dataframe libraries
A side-by-side comparison of the Polars and Pandas libraries.
I Migrated from a Postgres Cluster to Distributed SQLite with LiteFS
Why and how I migrated from distributed postgres to distributed sqlite on kentcdodds.com
Faster MySQL with HTTP/3
In this article we explore how our HTTP/3 API compares to the latency of a traditional MySQL client.
WAL Mode in LiteFS
LiteFS v0.3.0 now supports SQLite's write-ahead log journal mode.
Databases in 2022: A Year in Review
Andy Pavlo - Carnegie Mellon University,
SQLite 2022 Recap
There have been many improvements to SQLite during 2022. Listed below or just a few of the bigger changes. See the change logs or the trunk timeline for a more complete list of enhancements and improvements.
Understanding the N + 1 queries problem
In this post, I am going to talk about the N + 1 queries problem. While trying to solve this problem myself recently, I noticed most of the blog posts only talk about the very simple version of the problem and the proposed solutions would break down when the use cases get complex. I will try to get into more depth and…
Querying the GitHub archive with the ClickHouse playground
Via this comment on Hacker News I started exploring the ClickHouse Playground . It's really cool, and among other things it allows CORS-enabled API hits that can query a decade of history from the GitHub events archive in less than a second.