1
Command-line tools can be faster than your Hadoop cluster
Adam Drake is an advisor to scale-up tech companies. He writes about ML/AI/data, leadership, and building tech teams.
Most cited
Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 27 posts.
2
Will ZFS and non-ECC RAM kill your data?
This comes up far too often, so rather than continuing to explain it over and over again, I’m going to try to do a really good job of it once and link to it here.
3
Asynchronous Python and Databases
To quote the last part of this blog post, "I think it's [asyncio] really well done, it's fun to use, and I still am interested in having more of a SQLAlchemy story for it, because I'm sure folks will still want this no matter what anyone says.". To that end, SQLAlchemy 1.4 now includes complete support for asyncio …
4
Backblaze Vaults: Zettabyte-Scale Cloud Storage Architecture
Backblaze Vaults are not only incredibly durable, scalable, and performant, but they dramatically improve availability and operability.
5
Haunted by Data
This is the text version of a talk I gave on October 1, 2015, at the Strata+Hadoop World conference in New York City. The video version is here (20 mins).
6
Please stop calling databases CP or AP
This blog post has been translated into Russian , Japanese , Chinese , and Chinese again . For more detail on problems with CAP, and a proposal for an alternative, please see my paper A Critique of the CAP Theorem .
7
Farming Hard Drives: How Backblaze Weathered the Thailand Drive Crisis
The rain started in August and by mid-October 2011, violent floods in Thailand had damaged the factories that helped produce nearly half of the world’s
8
9
Call Me Maybe: MongoDB Stale Reads
Please note: our followup analysis of 3.4.0-rc3 revealed additional faults in MongoDB’s replication algorithms which could lead to the loss of acknowledged documents–even with Majority Write Concern, journaling, and fsynced writes.
10
11
Analyzing 1.1B NYC Taxi and Uber Trips
The New York City Taxi & Limousine Commission has released a staggeringly detailed historical dataset covering over 1.1 billion individual taxi trips in the city from January 2009 through June 2015. …
12
Call me maybe: Elasticsearch 1.5.0
Previously, on Jepsen , we demonstrated stale and dirty reads in MongoDB . In this post, we return to Elasticsearch, which loses data when the network fails, nodes pause, or processes crash.
13
Scaling Out PostgreSQL for CloudFlare Analytics Using CitusDB (YC S11)
When I joined CloudFlare about 18 months ago, we had just started to build out our new Data Platform. At that point, the log processing and analytics pipeline built in the early days of the company had reached its limits.
14
YC Stats
We get asked (a lot) for statistics on the YC portfolio about valuation and fundraising. Although these are very imperfect indicators of success, here they are. All of these companies actually went through a YC batch and got their start with us (e.g. we do not include Quora). Also, the YC application for the next…
15
DataLake
A Data Lake is a store that hold raw data as a source for data scientists to explore ways to gain information. It should not be accessed by end-users or used for system integration.
16
17
Which topics get the upvote on Hacker News?
Hacker News is a popular social news website, mostly covering technology and startup topics. It relies on user submissions and moderation, where each submitted story can be upvoted and commented by users, which in term determines whether the story reaches the front page and how long it stays there.
18
Parallel Sequential Scan is Committed to PostgreSQL 9.6
I previously suggested that we might be able to get parallel sequential scan committed to PostgreSQL 9.5. That did not happen. However, I...
19
20
Life in a post-database world: Using crypto to avoid database writes
Possibly one of the biggest hurdles that stands in the way of fostering innovation and discovering newer and better techniques of doing old things is the ease with which developers and designers to…
21
Data Science from Scratch: First Principles with Python
I am super-excited to announce that the book I've been working on for more than the last year, Data Science from Scratch: First Principles with Python is finally available! (buy from O'Reilly, use...
22
Announcing MongoDB 3.0
Official MongoDB Documentation. Learn to store data in flexible documents, create an Atlas deployment, and use our tools and integrations.
23
24
Modern SQL: With – Organize Complex Queries
The WITH clause adds named subqueries to SQL queries. WITH is also known as Common Table Expression (CTE).
25
Moving all your data, 9TB edition
At GitLab B.V. we are working on an infrastructure upgrade to give more CPU power and storage space to GitLab.com. Learn more here!
26
Finding MongoDB instances without any authentication
I would like to take a moment to discuss databases. Most people use Shodan to find devices that have web servers, but for a few years now I've also been crawling the Internet for various database software. I usually mention this during my talks and I've tried to raise awareness
27
IBash Notebook
Did you know that there's a Bash kernel for IPython Notebook? It even displays inline images. Could it ever be a convenient environment for doing data science? Would it be worthwhile to publish my book Data Science at the Command Line as a collection of notebooks?