1
Command-line tools can be faster than your Hadoop cluster
Adam Drake is an advisor to scale-up tech companies. He writes about ML/AI/data, leadership, and building tech teams.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 86 posts.
2
Call Me Maybe: MongoDB Stale Reads
Please note: our followup analysis of 3.4.0-rc3 revealed additional faults in MongoDB’s replication algorithms which could lead to the loss of acknowledged documents–even with Majority Write Concern, journaling, and fsynced writes.
3
Call me maybe: Aerospike
Previously, on Jepsen, we reviewed Elasticsearch’s progress in addressing data-loss bugs during network partitions. Today, we’ll see Aerospike 3.5.4, an “ACID database”, react violently to a basic partition.
4
5
6
7
Finding bugs in SQLite, the easy way
SQLite is probably the most popular embedded database in use today; it is also known for being exceptionally well-tested and robust. In co...
8
Top data mining algorithms in plain English
Today, I'm going to explain in plain English the top 10 most influential data mining algorithms as voted on by 3 separate panels in this survey paper. Once you know what they are, how they work, what they do and where you ... Read More
9
10
Call Me Maybe: MariaDB Galera Cluster
Previously, on Jepsen, we saw Chronos fail to run jobs after a network partition . In this post, we’ll see MariaDB Galera Cluster allow transactions to read partially committed state.
11
Open-Source Loan-Level Analysis of Fannie and Freddie
[M]ortgages were acknowledged to be the most mathematically complex securities in the marketplace. The complexity arose entirely out of the option the homeowner has to prepay his loan; it was poetic …
12
Call me maybe: Elasticsearch 1.5.0
Previously, on Jepsen , we demonstrated stale and dirty reads in MongoDB . In this post, we return to Elasticsearch, which loses data when the network fails, nodes pause, or processes crash.
13
Parallel Sequential Scan is Committed to PostgreSQL 9.6
I previously suggested that we might be able to get parallel sequential scan committed to PostgreSQL 9.5. That did not happen. However, I...
14
15
Practical Data Science in Python
Find, classify and remediate PII across your files, email, databases and cloud. Accurate AI-powered PII discovery – on-premise or SaaS.
16
PostgreSQL on the Command Line
Working efficiently with psql
17
How to create NBA shot charts in Python
In this post I go over how to extract a player's shot chart data and then plot it using matplotlib and seaborn .
18
Data first, not code first
Developers hate him! We'll cover some standard tips and tricks here, but we're not really interested in those. We're looking for the One Weird Trick to rule them all. Hopefully each trick we encounter brings us closer to coding Mecca. In the beginning The first video game I ever wrote was called Ninja Wars. Yes, that…
19
Call Me Maybe: Chronos
Chronos is a distributed task scheduler (cf. cron) for the Mesos cluster management system. In this edition of Jepsen , we’ll see how simple network interruptions can permanently disrupt a Chronos+Mesos cluster
20
21
Redis Geo
Note (version) : I wrote this originally as a Redis module in early 2014, then Redis included a modified version directly into official Redis releases in 2016. Note (implementation) : The implementation included with Redis 3.2+ changed some parameter orderings from my original (intentional, well-thought-out) design…
22
Data Science from Scratch: First Principles with Python
I am super-excited to announce that the book I've been working on for more than the last year, Data Science from Scratch: First Principles with Python is finally available! (buy from O'Reilly, use...
23
Thoughts on Time-series Databases
Preetam "recently" blogged about catena , a time-series metric store. There was another blog post about benchmarking boltdb by a Fog Creek engineer, also looking to write a time series database. This is something of a pattern in the Go community, which already boasts seriesly , InfluxDB , and prometheus ; there are…
24
Surviving Data Science at the Speed of Hype
john-foreman.com is your first and best source for information about john foreman. Here you will also find topics relating to issues of general interest. We hope you find what you are looking for!
25
26
Asynchronous Python and Databases
To quote the last part of this blog post, "I think it's [asyncio] really well done, it's fun to use, and I still am interested in having more of a SQLAlchemy story for it, because I'm sure folks will still want this no matter what anyone says.". To that end, SQLAlchemy 1.4 now includes complete support for asyncio …
27
28
29
Please stop calling databases CP or AP
This blog post has been translated into Russian , Japanese , Chinese , and Chinese again . For more detail on problems with CAP, and a proposal for an alternative, please see my paper A Critique of the CAP Theorem .
30