61
Zillow, Prophet, time series, and prices
So I made a mildly controversial tweet. Lots of people enjoyed it, but the LinkedIn-adjacent section of data science Twitter is not happy about it. I want to provide as much context for it as I can…
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 138 posts.
62
PostgreSQL, Memory and the Cloud
This post explains how Linux memory overcommit and OOM-killer behavior can turn a single runaway query into a full PostgreSQL crash, and why many managed cloud database services fail to disable overcommit the way self-hosted PostgreSQL recommends.
63
64
65
Data-Mining Wikipedia for Fun and Profit
The engineering blog of Bill P. Godfrey.
66
Cross-Database Queries in SQLite
I released Datasette 0.55 and sqlite-utils 3.6 this week with a common theme across both releases: supporting cross-database joins. Cross-database queries in Datasette SQLite databases are single files on disk. …
67
Introduction to Window Functions in SQL
It is interesting that many people working with data have no clue about window functions in SQL. During a long period of time instead of using window functions, I preferred coding in Python and panda…
68
No general method to detect fraud
The parts of a convincing deception
69
Breakdown of data on homeless populations across the U.S.
Many people see a homelessness crisis, but what does the data say? We examine different locations, rates of change, types of homelessness, and mental health and substance abuse issues.
70
Web Applications from the Future: A Database in the Browser
If progress follows it's usual strategy, then whatever is difficult and valuable to do today will become easy and normal tomorrow. I imagine we'll discover new abstractions, which will make writing Google Docs as easy as the average web app is today.
71
72
Zero-downtime schema migrations in Postgres using views
Schema migrations are tricky, especially when planned downtime is not an option. Changes need to be carefully designed to stay backwards compatible so that…
73
How to create a 1M record table with a single query
With recursive CTE and randomized data.
74
Rqlite 6.0: the evolution of a distributed database design
rqlite is a lightweight, open-source, distributed relational database written in Go, which uses SQLite as its storage engine. v6.0.0 is out now and makes clustering more robust. It also lays the foundation for more important features. What's new in 6.0? 6.0 multiplexes multiple logical connections between rqlite nodes…
75
Encoding Data in Dubstep Drops
[Warning: Those who can’t stand EDM/dubstep, oh boy do I have bad news for you in regards to this blog post]
76
Wikidata or Scraping Wikipedia
Yesterday I was pointed to a blog post describing how to answer an interesting project: how many generations from Alfred the Great to Elizabeth II ? Alfred the Great was a king in England at the end of the 9th century, and Elizabeth II is the current Queen of England (and a bit more).
77
New Machine Learning Gems for Ruby
In August, I set out to improve the machine learning ecosystem for Ruby and wasn’t sure where it would go. Over the next 5 months, I ended up...
78
Is BI dead? – On dismantling data's ship of Theseus
On dismantling data's ship of Theseus.
79
Tao: Facebook’s distributed data store for the social graph
The papers over the next few weeks will be from (or related to) research from VLDB 2021 - on the horizon is one of my favorite systems conferences SOSP . As always, feel free to reach out on Twitter with feedback or suggestions about papers to read! These paper reviews can be delivered weekly to your inbox , or you…
80
81
82
An opinionated map of incremental and streaming systems
Disclaimer: I used to work for Materialize which is one of the systems being compared in this post.
83
Inserting 130M SQLite rows per minute from a scripting language
The other week, I stumbled on the post Inserting One Billion Rows in SQLite Under A Minute , which was a funny coincidence, as I was just in...
84
85
Groundhog: Addressing the Threat That R Poses to Reproducible Research
R, the free and open source program for statistical computing, poses a substantial threat to the reproducibility of published research. This post explains the problem and introduces a solution. The…
86
Evidence of fraud in an influential field experiment about dishonesty
This post is co-authored with a team of researchers who have chosen to remain anonymous. They uncovered most of the evidence reported in this post. These researchers are not connected in any way to…
87
Good data scientist, bad data scientist
What separates a good Data Scientist from a bad one?
88
Excess Deaths in 2020
Update Updated on April 29th, 2021. The CDC continues to update its counts of deaths by cause for 2020 as data comes in from the jurisdictions that report to it. The data are by now fairly complete, though there are still significant gaps in several states due to delayed reporting. North Carolina, in particular, has…
89
Why I'm Lukewarm on Graph Neural Networks
{{ content|truncate(160) }}
90
Query Engines: Push vs. Pull
People talk a lot about “pull” vs. “push” based query engines, and it’s pretty obvious what that means colloquially, but some of the details can be a bit hard to figure out.