Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
How not to test that mysqld is alive
I had a call from a new customer last week. They had issues with their MySQL server. Apparently, it was repeatingly crashing, every few hours. To have their production system kept alive, they used …
Stack Overflow Creative Commons Data Dump
We decided early on that all user-generated content on Stack Overflow would be under a Creative Commons license . All those great Stack Overflow questions, answers, and comments, so generously contributed by all of you , are licensed under cc-wiki (also known as cc-by-sa ):
Atomic Commit in SQLite (2007)
An important feature of transactional databases like SQLite is "atomic commit". Atomic commit means that either all database changes within a single transaction occur or none of them occur. With atomic commit, it is as if many different writes to different sections of the database file occur instantaneously and…
Please don't use pie charts
I don't like pie charts. I don't like them because they fail to convey information. They do that because people have a really hard time ju...
Facebook's photo storage rewrite
This week Facebook will complete its roll-out of a new photo storage system designed to reduce the social network's reliance on expensive proprietary solutions from NetApp and Akamai. The new large blob storage system, named Haystack, is a custom-built file system solution for the over 850 million photos uploaded to…
Collaborative Map-Reduce in the browser
After immersing yourself into the field of distributed computing and large data sets you inevitably come to appreciate the elegance of Google's Map-Reduce framework . Both the generality and the simplicity of its map , emit , and reduce phases is what makes it such a powerful tool. However, while Google has made the…
Project Cassandra: Facebook's Open Source Alternative to Google BigTable
About a week ago, the Facebook Data team quietly released the Cassandra Project on Google Code. The Cassandra project has been described as a cross between ...
NYTimes.com Announces Map/Reduce Toolkit
Recently we’ve been exploring the on-demand storage and computation tools offered by Amazon Web Services, along with an open-source toolkit called Apache Hadoop. The result is many computers working together to answer questions about our users.
Put that database in memory
Writings on artificial intelligence, personalization, recommendations, and the tech industry.
Official Google Blog: Sorting 1PB with MapReduce
Insights from Googlers into our products, technology, and the Google culture
Large-scale graph computing at Google
Posted by Grzegorz Czajkowski, Systems Infrastructure TeamIf you squint the right way, you will notice that graphs are everywhere. For example, soc...
Gay marriage: the database engineering perspective
Update, 2017-09-25 Hi! This essay is undergoing a long-overdue rewrite. In the meantime, consider my 2015 follow-up essay, Obergefell v. Hodges: the database engineering perspective....