1111
Using Countdown Clock Data to Understand the New York City Subway
Ranking the lines by reliability, the anatomy of a delay, and a case for the $19 billion subway plan
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
1112
1113
Docker for data scientists: Introduction and use cases
Data scientists looking to learn Docker can get a brief intro and a look at how to improve your workflow
1114
1115
RegreSQL: Regression Testing for PostgreSQL Queries
Stop deploying broken SQL queries. RegreSQL provides regression testing for PostgreSQL queries with performance baselines and automated warnings.
1116
Mapping hospital accessibility with OpenStreetMap
Using OpenStreetMap data to craft a self-hosted interactive map of hospital accessibility in Virginia.
1117
Implementing a Principal Component Analysis In Python (2014)
Implementing Principal Component Analysis from scratch in Python: scatter matrices, eigenvectors, variance explained, and comparison with scikit-learn PCA.
1118
Extracting city blocks from OpenStreetMap data
Extracting blocks within a city as GeoJSON polygons from OpenStreetMap data
1119
Visualizing SQL Plan Execution Time with FlameGraphs
Update: I wrote a follow-up article about adding Loop Counters and Row Counts to SQL Plan FlameGraphs. I also show some old examples of “Bookshelf Graph” visualizations there. Check it out after reading this post first. Introduction Brendan Gregg invented and popularized a way to profile & visualize program response…
1120
Making database systems usable
C. J. Date's Sigmod 1983 keynote, "Database Usability", was prescient. Usability is the most important thing to the customers. They care les...
1121
SELECT wat FROM sql
Thanks to Nikhil Benesch, Justin Jaffray and several decades of "wouldn't it be nice if..." for contributions.
1122
Statistical Arbitrage – An Easy Walkthrough
Statistical arbitrage (stat arb) is a pillar of quantitative trading that relies on mean reversion to predict the future returns of an asset. Mean reversion believes that if a stock has risen higher it’s more likely to revert in the short term which is the opposite of a momentum strategy that believes if a stock has…
1123
1124
Visual Guide to NoSQL Systems
There are so many NoSQL systems these days that it's hard to get a quick overview of the major trade-offs involved when evaluating relational and non-relational systems in non-single-server...
1125
Exploring Word2Vec
In my previous blog post, I explored some of the early ways of word embeddings and their shortcomings. The purpose of this post is to explo...
1126
PostgreSQL 11 Reestablishes Window Functions Leadership
PostgreSQL 11 offers the best OVER clause support among its competitors, true procedures, and improvements in FETCH FIRST and XML.
1127
Gradient Boosted Decision Trees
From zero to gradient boosted decision trees
1128
UCLA professor refuses to cover for Dan Ariely in issue of data provenance
In one of the more bizarre twists of the Dan Ariely saga, there is a huge issue of provenance in one of Dan Ariely’s studies. The study in question is Dan Ariely’s Ten Commandments study at JMR. The hugely impactful paper has over 3,000 citations but unfortunately failed to replicate in a large-scale systematic…
1129
In Praise of ZFS on Linux's ZED 'ZFS Event Daemon'
You're probably reading this page because you've attempted to access some part of my blog (Wandering Thoughts) or CSpace , the wiki thing it's part of. Unfortunately you're using a browser version that my anti-crawler precautions consider suspicious, most often because it's too old (most often this applies to versions…
1130
Soma Water Filters Are Worthless
This experiment was inspired by a light-hearted argument with my wife, a stylish but atrocious water filter, and the explosion of start-ups attempting to turn everything you purchase into a subscription service.
1131
The Idiot's Guide to High Frequency Trading
First, let me say what you read here is going to be wrong in several ways. HFT covers such a wide path of trading that different parties participate or are impacted in different ways. I wanted to put this out there as a starting point . Hopefully the comments will help further educate us all
1132
How I work with Postgres – psql, My PostgreSQL Admin
On at least a weekly basis and not uncommonly multiple times in a single week I get this question: @neilmiddleton I’ve been hunting for a nice PG interface that works within other things. PGAdmin kinda works, except the SQL editor is a piece of shit Sometimes it leans more to, what is the Sequel Pro equivilant for…
1133
1134
Why I'm Lukewarm on Graph Neural Networks
{{ content|truncate(160) }}
1135
1136
Lessons Learned from Scaling to Multi-Terabyte Datasets
This post is meant to guide you through some of the lessons I’ve learned while working with multi-terabyte datasets. The lessons shared are focused on what someone may face as the size of the…
1137
Zmij: Faster floating point double-to-string conversion
There comes a time in every software engineer’s life when they come up with a new binary-to-decimal floating-point conversion method. I guess my time has come. I just wrote one, mostly over a weekend: https://github.com/vitaut/zmij .
1138
1139
Our humble attempt at “how much data do you need to fine-tune”
Efficacy of OpenAI Fine-tuning API, Cost/Latency Considerations, Experiencing Catastrophic Forgetting, and...Getting Roasted by a Fine-tuned GPT-3.5
1140
