1
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 105 posts.
2
3
4
Let’s Build a Simple Database (2017)
Writing a sqlite clone from scratch in C
5
When your data doesn’t fit in memory: the basic techniques
You can process data that doesn’t fit in memory by using four basic techniques: spending money, compression, chunking, and indexing.
6
Weld: Accelerating numpy, scikit and pandas as much as 100x with Rust and LLVM
Lambdaclass's blog about distributed systems, machine learning, compilers, operating systems, security and cryptography.
7
8
9
Event Sourcing is Hard
Despite it being sold as the one true path, event sourcing comes with some pain points when you try to put its ideas into production.
10
Xor Filters: Faster and Smaller Than Bloom Filters
In software, you frequently need to check whether some objects is in a set. For example, you might have a list of forbidden Web addresses. As someone enters a new Web address, you may want to check whether it is part of your black list. Or maybe you have a large list of already used … Continue reading Xor Filters…
11
Why databases use ordered indexes but programming uses hash tables
I think it is safe to state that hash tables (e.g. maps in Go, dicts in Python, HashMap in Java, etc.) are far more common than ordered data structures such as trees for in-memory data structures. One data point is that in a talk about C++ hash table optimization at Google ( available in Abseil ), the speaker noted…
12
It’s Time to Move on from Two Phase Commit
The two-phase commit protocol (2PC) has been used in enterprise software systems for over three decades . It has been an an incredibly impa...
13
A Visual Intro to NumPy and Data Representation
Discussions: Hacker News (366 points, 21 comments), Reddit r/MachineLearning (256 points, 18 comments) Translations: Chinese 1, Chinese 2, Japanese, Korean The NumPy package is the workhorse of data analysis, machine learning, and scientific computing in the python ecosystem. It vastly simplifies manipulating and…
14
Doing a database join with CSV files
How to combine data spread over two CSV files, like separate tables in a normalized relational database.
15
16
17
18
Common statistical tests are linear models
By Jonas Kristoffer Lindeløv ( blog , profile ). Last updated: 28 June, 2019 (See changelog ). Check out the Python version and the Twitter summary .
19
The Next 50 Years of Databases (2015)
Andy attempts to revive his blog by predicting what databases will look like in the year 2065.
20
Xkcd-Style Plots in Matplotlib (2012)
Update: the matplotlib pull request has been merged! See This post for a description of the XKCD functionality now built-in to matplotlib!
21
22
23
ORMs Are Backwards
Not bad just backwards
24
Storing UTC is not a silver bullet
Note: this is a pretty long post. If you’re not interested in the details, the conclusion at the bottom is intended to be read in a standalone fashion. There’s also a related blog post …
25
26
Using Altair for most of my visualization in Python
Fernando Irarrázaval Stream of consciousness about Data Science, Python, and Economics.
27
Modern Data Practice and the SQL Tradition
This made it to the Hacker News front-page too: some very interesting comments there
28
29
AWS Elasticsearch: a fundamentally-flawed offering
I'm currently working on a logging project that was initially implemented using AWS Elasticsearch. Having worked with large-scale mainline Elasticsearch clusters for several years, I'm absolutely stunned at how poor Amazon's implementation is and I can't fathom why they're unable to fix or at least improve it. I…
30
Memory Management in Python
To speed-up memory operations and reduce fragmentation Python uses a special manager on top of the general-purpose allocator, called PyMalloc.