New
The latest blog posts to take off on Hacker News. 141 posts.
NYC has released data for every tax lot in the city. Here is my first look
Many thanks to advocates inside and outside who worked tirelessly for years to liberate one of New York City’s most fundamental datasets. Many more thanks to the efforts of Department of City Planning, DoITT, and the Chief Analytics Officer’s office. THANK YOU!
Android Fragmentation Visualized
Our reports examine national and regional trends in mobile and broadband network experience, and develop in-depth insights into trends impacting consumer network experience.
SQL Server 2014 Standard Edition Sucks
The best new features in SQL Server 2014 probably won't come with the cheap prices or licensing. Learn why the release date will probably be an expensive one.
Jepsen: On the perils of network partitions
This article is part of Jepsen , a series on network partitions. We’re going to learn about distributed consensus, discuss the CAP theorem’s implications, and demonstrate how different databases behave under partition.
Useful Unix commands for data science
The command line tools that ship with any Unix-like system are extremely handy for many data tasks. Here are some of the ones that I've found most useful.
RethinkDB 1.7: hot backup, atomic set/get, 10x insert performance improvement
Etienne Laurin ( @atnnn ), an engineer at RethinkDB, introduces these new features in this one-minute video:
Algorithms Every Data Scientist Should Know: Reservoir Sampling
Cloudera Blog is your source for expert guidance on the latest data and AI trends, technology innovation, best practices, success stories, and more.
PostgreSQL needs a new load balancer
We do a lot of high-availablity PostgreSQL deployments for clients. As of 9.1, streaming replication (SR) is excellent for this, and can sc...
Announcing pqR: A faster version of R
pqR — a “pretty quick” version of R — is now available to be downloaded, built, and installed on Linux/Unix systems. This version of R is based on R-2.15.0, but with many performance im…
MySQL man pages silently relicensed away from GPL
It has recently been brought to our attention that the MySQL man pages have been relicensed. The change was made rather silently going from MySQL 5.5.30 to MySQL 5.5.31. This affects all pages in the man/ directory of the source code. You can tell the changes have come during this short timeframe (5.5.30->5.5.31). The…
RethinkDB 1.6 is out: regex matching, new array operations, random sampling
This release includes regex string matching, fourteen new array operations, support for random sampling, error handling improvements, support for authentication keys, and over 65 bug fixes, features, and enhancements.
Using Metadata to Find Paul Revere
London, 1772. I have been asked by my superiors to give a brief demonstration of the surprising effectiveness of even the simplest techniques of the new-fangled Social Networke Analysis in the pursuit of those who would seek to undermine the liberty enjoyed by His Majesty’s subjects. This is in connection with the…
Run SQL on JSON files without any data loads
Citus gives you all the greatness of Postgres plus the superpowers of distributed tables. By distributing your data and queries, your application gets high performance—at any scale. The Citus database is available as open source and as a managed service on Azure.
Non-blocking transactional atomicity
tl;dr: You can perform non-blocking multi-object atomic reads and writes across arbitrary data partitions via some simple multi-versioning and by storing metadata regarding related items.
SQLite improves performance with memory-mapped I/O
A complete list of SQLite releases in a single page and a chronology are both also available. A detailed history of every check-in is available at SQLite version control site .
Call me maybe: final thoughts
Previously in Jepsen , we discussed Riak . Now we’ll review and integrate our findings.
Jepsen: Postgres
Previously on Jepsen , we introduced the problem of network partitions . Here, we demonstrate that a few transactions which “fail” during the start of a partition may have actually succeeded.
Jepsen: Redis
Previously on Jepsen , we explored two-phase commit in Postgres . In this post, we demonstrate Redis losing 56% of writes during a partition.