91
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 116 posts.
92
Why ZFS is not good at growing and reshaping pools, or shrinking them
You're probably reading this page because you've attempted to access some part of my blog (Wandering Thoughts) or CSpace , the wiki thing it's part of. Unfortunately you're using a browser version that my anti-crawler precautions consider suspicious, most often because it's too old (most often this applies to versions…
93
Combining event sourcing and stateful systems
Bridging the gap between stateful and event sourced sub-systems
94
How to get stock fundamentals data with Python
Learn how to download fundamentals data with Python using the yahoo_fin package, including P/E and P/S ratios, return on equity, and more.
95
Migrating a 40TB SQL Server Database
Initially, I wasn’t sure whether to write about this migration project, but when I randomly asked if people would be interested, the response was overwhelming. This was a long, kind of boring, very repetitive, and at times incredibly frustrating project, but I learned a lot, and maybe someone else will learn from this…
96
97
Migrating Large Heroku Postgres Instances to AWS Aurora Without Downtime
In this article I discuss a general process I used recently to migrate a large multi-terabyte Heroku Postgres Database from the Heroku Platform to Amazon Aurora Postgres on a live Heroku based application architecture with near zero downtime and builtin failover during the process.
98
Domain Logic and SQL (2003)
A long-form article entitled: "Domain Logic and SQL"
99
CQRS: Command Query Responsibility Segregation (2011)
CQRS (Command Query Responsibility Segregation) is the notion that you can use a different model to update information than the model you use to read information
100
Feature Casualties of Large Databases
Databases shed important RDMS features as they get big. Examining why this tends to be the case, and some ideas for preventing it.
101
Loading NumPy arrays from disk: mmap() vs. Zarr/HDF5
Learn how to load larger-than-memory NumPy arrays from disk using either mmap() (using numpy.memmap), or the very similar Zarr and HDF5 file formats.
102
Diffing Coronaviruses
Comparing the genome sequences of the Wuhan coronavirus and a bat coronavirus using `diff` and NCBI BLAST reveals an 89% similarity.
103
104
ZFS: Use mirror vdevs, not RAIDZ
Continuing this week’s “making an article so I don’t have to keep typing it” ZFS series… here’s why you should stop using RAIDZ, and start using mirror vdevs instead.
105
Immutable Databases
Like blockchain but without blockchain.
106
Writing a Postgres Foreign Data Wrapper for Clickhouse in Go
Postgres(hereinafter mentioned as PG) is a pretty cool database with lots of nice features, one of them little known ones is the ability of having Foreign data wrappers (hereinafter mentioned as FDWs). Clickhouse(hereinafter mentioned as CH) is another amazing database with an altogether different set of features…
107
VisiData in 60 Seconds
Download faa-wildlife-strikes.csv , a dataset of all aircraft-wildlife collisions reported to the Federal Aviation Administration between 2010 and mid-2016.
108
109
How to Think about Correlation?
I am an economist at the Federal Trade Commission with a very basic statistics question, one that I have put to several fairly high-powered econometricians, and to which no one has had a satisfying answer.
110
Three Types of Data
In my work I’ve developed a mental framework related to data modeling, which has helped greatly both when coming up with a model and when making decisions down the road about how to use that model. Here I will establish three different categories of data in software: Constants, State, and Cached Values. By “data” I…
111
Holes in Bayesian Statistics
Every philosophy has holes, and it is the responsibility of proponents of a philosophy to point out these problems. Here are a few holes in Bayesian data analysis: (1) the usual rules of conditional probability fail in the quantum realm, (2) flat or weak priors lead to terrible inferences about things we care about…
112
A synthetic control causal analysis of Musk's tweet on Tesla stock price
a terse analysis of tesla stock prices and how one of elon’s tweets moves them
113
Understanding Raft Consensus
Recently I was digging deeper into Raft , an important algorithm in the field of distributed systems. Raft is a consensus algorithm , meaning that it is designed to facilitate a set of computers agreeing on a state of the world (more on exactly how the state of the world is represented later), even when communications…
114
Common Problems in Financial Services Reconciliation
Common problems in financial recon, for fintechs, particularly those building deposit products and managing their own ledger.
115
Analysis of all YouTube trending videos in US for 2019
This analysis was featured on: The Hustle newsletter (lead story), TechCrunch, Hacker News, The Growth Newsletter (issue #021), Social Blade, Data Science...
116
Target didn’t figure out a teen girl was pregnant before her father did
And that one article that said they did was silly and bad