Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
Wolfram Alpha Personal Analytics for Facebook
Wolfram|Alpha analyzes your Facebook data for free. Compute statistics: posting activity, most liked post, words most used, friends' geography, age and genders... more than a dozen reports.
The Truth About Linear Regression (2015)
This is basically a compilation of the lecture notes I wrote when teaching 36-401, Modern Regression, in fall 2015 . I offer it here on the chance that it might be of interest to those learning, or teaching, linear regression. There's no shortage of resources on that, but I have tried to present the subject as though…
Static B-Trees: A data structure for faster binary search
This section is a follow-up to the previous one , where we optimized binary search by the means of removing branching and improving the memory layout. Here, we will also be searching in sorted arrays, but this time we are not limited to fetching and comparing only one element at a time.
Understanding the BM25 full text search algorithm
BM25 is a widely used algorithm for full text search. I wanted to understand how it works, so here is my attempt at understanding by re-explaining.
Storing UTC is not a silver bullet
Note: this is a pretty long post. If you’re not interested in the details, the conclusion at the bottom is intended to be read in a standalone fashion. There’s also a related blog post …
Pushing ChatGPT's Structured Data Support to Its Limits
“Function calling” with ChatGPT is ChatGPT’s best feature since ChatGPT.
78% of Reddit Threads with 1,000+ Comments Mention Nazis
Let me start this post by noting that I will not attempt to test Godwin’s Law , which states that:
Following a Select Statement Through Postgres Internals (2014)
This is the third of a series of four posts based on a presentation I did at the Barcelona Ruby Conference called “20,000 Leagues Under ActiveRecord.” (posts: one two four and video ).
PostGIS at 20, the Beginning
Twenty years ago today, the first email on the postgis users mailing list (at that time hosted on yahoogroups.com) was sent, announcing the first numbered release of PostGIS. The early history of PostGIS was tightly bound to a consulting company I had started a few years prior, Refractions Research. My first contracts…
Jepsen: VoltDB 6.3
In the last Jepsen post, we found that RethinkDB could lose data when a network partition occurred during cluster reconfiguration. In this analysis, we’ll show that although VoltDB 6.3 claims strict serializability, internal optimizations and bugs lead to stale reads, dirty reads, and even lost updates; fixes are now…
Pretty maps in Python
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
I downloaded all 1.6M posts on Bluesky
I downloaded all the posts on Bluesky as of 2023-05-01. Then I did some data analysis on the 1680399 posts from 45457 accounts.
PostgreSQL community impact of 2nd Quadrant purchase
This blog is about my work on the Postgres open source database, and is published on Planet PostgreSQL. PgLife allows monitoring of all Postgres community activity.
Dear Postgres
Dear Postgres, I’ve always felt an affinity for you in my 9 years of working with you. I know others have known you longer, but that doesn’t mean they love you more. Years ago when others complained about your rigidness or that you weren’t as accommodating as others I found solace in your steadfast values: Don’t lose…
Cola: A text CRDT for real-time collaborative editing
A deep dive into the theoretical framework and the technical implementation of a text CRDT.
Most Female and Male Occupations Since 1950
The shifting majorities of the sexes in the workplace.
Datasette is my data hammer
If you're exploring or publishing data, you should give this open source tool a go.
Ten years of improvements in PostgreSQL's optimizer
Ryan Marcus, assistant professor at the University of Pennsylvania. Using machine learning to build the next generation of data systems.
I don't want to learn your query language (2018)
This is a bit of a rant but I really don't like software that invents its own query language. There's a trillion different ORMs out there. Another trillion databases with their own query language. Another trillion SaaS products where the only way to query is to learn some random query DSL they made up.
SQL Anti-Patterns
Introduction
Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS
Today is a very exciting day as we release Amazon DynamoDB, a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. DynamoDB is the result of 15 years of learning in the areas of large scale non-relational databases and cloud services. Several years ago we published…
Reddit's database has only two tables
Steve Huffman talks about Reddit’s approach to data storage in a High Scalability post from 2010. I was surprised to learn that they only have two tables in their database.
Why xkcd-style graphs are important
For most data scientists, a toolkit like scipy/matplotlib or R becomes so familiar that it becomes almost an extension of their own mind. When fleshing out an idea, we will just open up ipython, write a few lines of code, and display the plot on the screen to get …
A simple search engine from scratch
*if you include word2vec.