Topics /

Databases & Data

The most popular blog posts about databases & data on Hacker News. 74 posts.

2009
52

Facebook's photo storage rewrite

This week Facebook will complete its roll-out of a new photo storage system designed to reduce the social network's reliance on expensive proprietary solutions from NetApp and Akamai. The new large blob storage system, named Haystack, is a custom-built file system solution for the over 850 million photos uploaded to…

53

Collaborative Map-Reduce in the browser

After immersing yourself into the field of distributed computing and large data sets you inevitably come to appreciate the elegance of Google's Map-Reduce framework . Both the generality and the simplicity of its map , emit , and reduce phases is what makes it such a powerful tool. However, while Google has made the…

55

NYTimes.com Announces Map/Reduce Toolkit

Recently we’ve been exploring the on-demand storage and computation tools offered by Amazon Web Services, along with an open-source toolkit called Apache Hadoop. The result is many computers working together to answer questions about our users.