New
The latest blog posts to take off on Hacker News. 141 posts.
Data looks better naked
Rather than dressing data up, strip it down—remove to improve.
Knossos: Redis and Linearizability
A few weeks ago I criticized a proposal by Antirez for a hypothetical linearizable system built on top of Redis WAIT and a strong coordinator. I showed that the coordinator he suggested was physically impossible to build, and that anybody who tried to actually implement that design would run into serious problems. I…
Call me maybe: Redis redux
In a recent blog post , antirez detailed a new operation in Redis: WAIT . WAIT is proposed as an enhancement to Redis’ replication protocol to reduce the window of data loss in replicated Redis systems; clients can block awaiting acknowledgement of a write to a given number of nodes (or time out if the given threshold…
102TB of New Crawl Data Available
We are very please to announce that new crawl data is now available! The data was collected in 2013, contains approximately 2 billion web pages and is 102TB in size (uncompressed).
Linux memory manager and your big data
Citus gives you all the greatness of Postgres plus the superpowers of distributed tables. By distributing your data and queries, your application gets high performance—at any scale. The Citus database is available as open source and as a managed service on Azure.
RethinkDB 1.11 is out: query profiler, new streaming algorithm, devops features
Today, we’re happy to announce RethinkDB 1.11 ( Breakfast at Tiffany’s ), which improves the experience of operating live RethinkDB deployments. Download it now!
MySQL 5.7: over 1M queries/sec on a single machine
Last week, during Tomas ' keynote at MySQL Percona Live Conference in London we announced as one of "previews" of the following MySQL 5.7 release(s) -- an over 1,000,000 Query/sec result obtained with InnoDB Memcached plugin on a Read-Only workload. This article here is just to confirm the announced results without…
How Python became the language of choice for data science
Nowadays Python is probably the programming language of choice (besides R) for data scientists for prototyping, visualization, and running data analyses on small and medium sized data sets. And...
How to make fake data look meaningful
If you are trying to trick somebody with your data, never share the raw data; only share the conclusions. Bonus points if you can’t share the data because it is somehow priviledged or a trade secret. The last thing you want is to allow other people to evaluate your analysis and possibly challenge your conclusions.
Modelling a Basic Income with Python and Monte Carlo Simulation
Basic Income is a popular policy floating around the internet lately. The idea consists of declaring that the government will pay each living adult a fixed amount of money every month - an amount comparable to a minimum wage job. This policy would then replace all current welfare programs - welfare, unemployment …
SparkFun's migration from MariaDB to PostgreSQL
The devs switch underlying databases for SparkFun.com and somehow, miraculously, the sky stays put firmly up above.
MongoDB is to NoSQL like MySQL to SQL - in the most harmful way
MySQL and MongoDB are both popular, yet poor representatives of their species
The Big Data Brain Drain: Why Science is in Trouble
Update, August 2014: see Hacking Academia , my most recent reflection on this subject.
Datomic Pro Starter Edition
The free database designed for immutable values and a time-aware information model.
Hstore development for 9.4 release
I returned back home from PGCon.EU-2013 conference, Dublin, Ireland, where we gave two talks - Next Generation of GIN and Binary storage for nested data structures and application to hstore data type . These projects as well as visiting the conference (I, Teodor Sigaev and Alexander Korotkov) were…
Principal Component Analysis for Dummies
(I recently wrote a new post that you may also find interesting called Principal Component Analysis 4 Philosophers) Having been in the social sciences for a couple of weeks it seems like a large am…
Introducing Riak 2.0: Data Types, Strong Consistency, Full-Text Search
The Technical Preview of Riak 2.0 is now available for download.
Million Lines of Code - Infographic
Is a million lines of code a lot? How many lines of code are there in Windows? Facebook? iPhone apps? Let our data-visualization program your brain.
Bloom Filters by example
A Bloom filter is a data structure designed to tell you, rapidly and memory-efficiently, whether an element is present in a set.
Intro to Pandas data structures
Part one of a three part introduction to the pandas library. Geared towards SQL users, but is useful for anyone wanting to get started with pandas.