3211
Spark as a Compiler: Joining a Billion Rows per Second on a Laptop
Discover how Apache Spark can join a billion rows per second on a laptop, showcasing its powerful data processing capabilities.
New
The latest blog posts to take off on Hacker News. 4,224 posts.
3212
3213
3214
Online tracking: A 1-million-site measurement and analysis
Online tracking: A 1-million-site measurement and analysis is the largest and most detailed measurement of online tracking to date. We measure stateful (cookie-based) and stateless (fingerprinting-based) tracking, the effect of browser privacy tools, and "cookie syncing". This measurement is made possible by our web…
3215
Understanding consensus and Paxos in distributed systems
A whirlwind tour on acheiving agreement in a distributed system
3216
One Billion Drive Hours and Counting: Q1 2016 Hard Drive Stats
61,590 hard drives were used in our data center during Q1, 2016. We take a deep dive into the usage to see what we can learn about their performance.
3217
PostgreSQL 9.6 Beta 1 Released
The PostgreSQL Global Development Group announces today that the first beta release of PostgreSQL 9.6 is available for download. This …
3218
3219
3220
Time Series, the new shiny?
If you’ve been fortunate enough to have been studying penguins at McMurdo these last few seasons you may have missed the attention “Time Series” has been getting in the Big Data space. Then again, maybe not. Because if you were doing scientific work whilst snug in your North Face you may have been t
3221
Finding Similar Music Using Matrix Factorization
In a previous post I wrote about how to build a ‘People Who Like This Also Like …’ feature for displaying lists of similar musicians. My goal was to show how simple Information Retrieval techniques can do a good job calculating lists of related artists. For instance, using BM25 distance on The Beatles shows the most…
3222
PostgreSQL Scalability: Towards Millions TPS
PostgreSQL scalability on multicore and multisocket machines became a subject of optimization long time ago once such machines became widely used. This blog post shows brief history of vertical scalability improvements between versions 8.0 and 8.4. PostgreSQL 9.2 had very noticeable scalability improvement. Thanks to…
3223
3224
XKCD Plots in Matplotlib: Going the Whole Way
One of the most consistently popular posts on this blog has been my XKCDify post, where I followed in the footsteps of others to write a little hack for xkcd-style plotting in matplotlib. In it, I mentioned the Sketch Path Filter pull request that would eventually supersede my ugly little hack.
3225
Serializable, Lockless, Distributed: Isolation in CockroachDB
To protect concurrent transactions from anomalies that can break the consistency of CockroachDB, we require an Isolation guarantee...
3226
78% of Reddit Threads with 1,000+ Comments Mention Nazis
Let me start this post by noting that I will not attempt to test Godwin’s Law , which states that:
3227
The Impact of Index Investing: A Follow-Up
The prior piece received a much stronger reaction than I expected. The topic is complicated, with ideas that are difficult to adequately convey in words, so I’m going to use this piece as a follow-up. I’m going to look at the specific example of the Tech Bubble, which is a clear case in which the broad adoption of a…
3228
3229
A Guide to Bayesian Statistics
A guide for getting started with Bayesian Statistics! Start your way with Bayes' Theorem and end up building your own Bayesian Hypothesis test!
3230
3231
SQL Tricks
Listicles like these do work – not only do they attract attention, if the content is also valuable (and in this case it is, trust me), the article format can be extremely entertaining. This a…
3232
Backblaze Releases the Reed-Solomon Java Library for Free
Today we are releasing our latest open-source project: Backblaze Reed-Solomon Java library for erasure coding. Click for details on how to use and download.
3233
The impact of Prince’s death on Wikipedia
“Prince is synonymous with indulging in yourself shamelessly and with passion. His music and his cultural impact mean more than words can offer.” “He taught me that being black wa…
3234
Sorry ARIMA, but I’m Going Bayesian
When people think of “data science” they probably think of algorithms that scan large datasets to predict a customer’s next move or interpret unstructured te...
3235
3236
3237
England and Wales House Price Analysis
The last time I looked at house prices it went pretty well, and I ended up winning a data science competition. There I was only dealing with a million or so records, and a relatively small 120 MB dataset. Then I found out it was possible to download 3.7GB of property sale records for all of England and Wales since…
3238
3239
Amazon S3 Transfer Acceleration
Several AWS teams are focused on simplifying and accelerating the process of moving on-premises data to the cloud. We started out with the very basic PUT operation and multipart upload in the early days. Along the way we gave you the ability to send us a disk, and made that process even easier by launching […]
3240