Most cited
Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 29 posts.
Using Metadata to Find Paul Revere
London, 1772. I have been asked by my superiors to give a brief demonstration of the surprising effectiveness of even the simplest techniques of the new-fangled Social Networke Analysis in the pursuit of those who would seek to undermine the liberty enjoyed by His Majesty’s subjects. This is in connection with the…
Jepsen: Postgres
Previously on Jepsen , we introduced the problem of network partitions . Here, we demonstrate that a few transactions which “fail” during the start of a partition may have actually succeeded.
Don't use Hadoop when your data isn't that big
"So, how much experience do you have with Big Data and Hadoop?" they asked me. I told them that I use Hadoop all the time, but rarely for jobs larger than a few TB. I'm basically a big data neophite - I know the concepts, I've written code, but never at scale.
Jepsen: Redis
Previously on Jepsen , we explored two-phase commit in Postgres . In this post, we demonstrate Redis losing 56% of writes during a partition.
Million Lines of Code - Infographic
Is a million lines of code a lot? How many lines of code are there in Windows? Facebook? iPhone apps? Let our data-visualization program your brain.
Jepsen: On the perils of network partitions
This article is part of Jepsen , a series on network partitions. We’re going to learn about distributed consensus, discuss the CAP theorem’s implications, and demonstrate how different databases behave under partition.
Call me maybe: Cassandra
Cassandra is a Dynamo system; like Riak, it divides a hash ring into a several chunks, and keeps N replicas of each chunk on different nodes. It uses tunable quorums, hinted handoff, and active anti-entropy to keep replicas up to date. Unlike the Dynamo paper and some of its peers, Cassandra eschews vector clocks in…
Scaling Django to 8 Billion Page Views
At more than 8 billion page views per month and 45k requests per second, we’ve learned a couple things about delivering comments at scale.
Useful Unix commands for data science
The command line tools that ship with any Unix-like system are extremely handy for many data tasks. Here are some of the ones that I've found most useful.
Introducing Heka
We here on the Mozilla Services team are happy to announce our first beta release (v0.2b1) of Heka, a tool for high performance data gathering, ...
Data Science of the Facebook World
Stephen Wolfram shares interesting Facebook data analysis finds from the Data Donor program of Wolfram|Alpha Personal Analytics for Facebook.
Data looks better naked
Rather than dressing data up, strip it down—remove to improve.
Wikipedia Adopts MariaDB
This past Wednesday marked a milestone in the evolution of Wikimedia’s Database infrastructure: the completion of the migration of the English and German Wikipedias, as well as Wikidata, to M…
Why Cassandra Doesn't Need Vector Clocks
Deepening watsonx capabilities to address enterprise gen AI data needs with DataStax.
Modelling a Basic Income with Python and Monte Carlo Simulation
Basic Income is a popular policy floating around the internet lately. The idea consists of declaring that the government will pay each living adult a fixed amount of money every month - an amount comparable to a minimum wage job. This policy would then replace all current welfare programs - welfare, unemployment …
Command-line tools for data science
Blog article by Jeroen Janssens. Sep 19, 2013. 21 min read. Data science is OSEMN (pronounced as awesome). That is, it involves Obtaining, Scrubbing, Exploring, Modelling, and iNterpreting data. As a data scientist, I spend quite a bit of time on the command-line, especially when there’s data to be obtained, scrubbed…
Call me maybe: Redis redux
In a recent blog post , antirez detailed a new operation in Redis: WAIT . WAIT is proposed as an enhancement to Redis’ replication protocol to reduce the window of data loss in replicated Redis systems; clients can block awaiting acknowledgement of a write to a given number of nodes (or time out if the given threshold…
How I work with Postgres – psql, My PostgreSQL Admin
On at least a weekly basis and not uncommonly multiple times in a single week I get this question: @neilmiddleton I’ve been hunting for a nice PG interface that works within other things. PGAdmin kinda works, except the SQL editor is a piece of shit Sometimes it leans more to, what is the Sequel Pro equivilant for…