1321
Lisp Query Notation (LQN)
Query language and terminal utility for transforming various data formats
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
1322
1323
Can we replace a $150k Looker with a bucket of HTML files?
(BI) Software is dead, apparently
1324
Loading Pydantic models from JSON without running out of memory
Pydantic’s JSON loading uses a huge amount of memory; here’s how to reduce it.
1325
Just make it scale: An Aurora DSQL story
AWS Senior Principal Engineers, Niko Matsakis and Marc Bowes, take us inside Aurora DSQL's development: scaling write operations without two-phase commit, overcoming garbage collection hurdles, and embracing Rust for both data and control planes.
1326
Finding Similar Music Using Matrix Factorization
In a previous post I wrote about how to build a ‘People Who Like This Also Like …’ feature for displaying lists of similar musicians. My goal was to show how simple Information Retrieval techniques can do a good job calculating lists of related artists. For instance, using BM25 distance on The Beatles shows the most…
1327
Catena: A time series storage engine written in Go
First, I suggest reading Baron’s “Time-Series Database Requirements” blog post to get some more context for this post. I read that and, as I usually do, had my mind set on low-level thoughts. I wrote the following comment:
1328
Working with the Clinton State Dept Email Dumps in R, Part 1
This isn’t a post about politics. I do have opinions about the now infamous e-mail server (which will no doubt come out here), but when the WSJ folks made it possible to search the Clinton email releases I though it would be fun to get the data into R to show how well the igraph and ggnetwork packages could work…
1329
Learning Python for Social Scientists (2015)
I’ve compiled a list of Python tutorials and annotated analyses. I've tried to list pages that are accessible to social scientists with little background in Python and/or machine learning.
1330
Kafka at the low end: how bad can it get?
There is oft-quoted advice that Kafka does poorly as a job queue. I’ve experienced this myself, and I wanted to formalize it a bit.
1331
Results of the SQL Performance Quiz
SQL indexing: 60% don’t know how to get it right
1332
UUID Benchmark War
This month’s PGSQL Phriday #015 topic is about UUIDs, hosted by Lætitia Avrot. Lætitia has called for a debate. No, no, no. I say let’s have an all-out war. A benchmark war. I have deci…
1333
Spanish traders set the standard for GnuCash database design
TLDR: Spanish traders in the 1600s did not want to count their thumbs, which influenced GnuCash's database design choices in 1997. Much like a horse's arse set the standard for railways . How seemingly odd design turns out to be a genius solution that serves people pretty well.
1334
ULIDs and Primary Keys
Not all non-sequential primary keys are created equal, the ULID format is a fantastic substitute for the typical UUIDv4 choice.
1335
Setting up PostgreSQL for running integration tests
Setting up PostgreSQL for tests is crucial for achieving performance and reliability. In this article, I'll explain how to set up PostgreSQL for tests and discuss some common pitfalls to avoid.
1336
1337
Why is Snapshot Isolation not enough?
Let's talk about why Snapshot Isolation is not enough for a general purpose concurrency control. Snapshot Isolation has been adap...
1338
1339
1340
How Bad Is Your Colormap? (2014)
What this function does is to give you a lumninance-correct grayscale version of any matplotlib colormap. I've found this useful for quickly checking how my plots might appear if printed in black and white, but I think it's probably even more useful for stoking the flame of the internet's general rant against jet .
1341
1342
SQLite does not do checksums
SQLite does not do checksums by default. Disk corruptions go silently unnoticed.
1343
Modern Polars: A comparison of the Polars and Pandas dataframe libraries
A side-by-side comparison of the Polars and Pandas libraries.
1344
1345
PostgreSQL Benchmark on FreeBSD, CentOS, Ubuntu Debian and OpenSUSE
In this post, I’m going to show benchmark results of the recently released PostgreSQL 10.1. I’ve benchmarked the DB on these OSes (all are 64-bit):
1346
Jsonb: Stories about performance
As such, there’s really no “standard” benchmark that will inform you about the best technology to use for your application. Only your requirements, your data, and your infrastructure can tell you what you need to know.
1347
What's wrong with statistics in Julia?
Introduction Link to heading Several months ago, I promised to write an updated version of my old post, “The State of Statistics in Julia”, that would describe how Julia’s support for statistical computing has evolved since December 2012. I’ve kept putting off writing that post for several reasons, but the most…
1348
New Data Science Certificate Program
Starting in the fall of 2012, the University of Washington will be offering a certificate in Data Science . The program has two sections: one located in Seattle and the other online. The certificate consists of three separate courses each lasting approximately 3 months. Thus the program can be completed in 9 months…
1349
Transforming Wikipedia into a cultural knowledge quiz
Building “Test Your Culture” by taking the world’s largest encyclopedia… and combining it with data science
1350
