The Simpsons by the Data
Analysis of Simpsons characters, dialogue, TV ratings, and more
The latest blog posts to take off on Hacker News. 1,888 posts.
Analysis of Simpsons characters, dialogue, TV ratings, and more
An article for none-Japanese readers....What I'm recently working on is a feature to load data blocks from NVMe-SSD to GPU using peer-to-peer DMA. It allows to bypass the CPU/RAM under a series of data loading process, thus, also allows to reduce number of expensive data copy. Once data blocks are l…
PostgreSQL Talk
By using a combination of curl, grep, cut, sort, uniq and other common bash utilities it is possible to extract structured data from Wikipedia and compute insights without writing a full program.
Extracting blocks within a city as GeoJSON polygons from OpenStreetMap data
Content-aware fill is a powerful tool designers and photographers use to fill in unwanted or missing parts of images. Image completion and inpainting are closely related technologies used to fill in missing or corrupted parts of images. There are many ways to do content-aware fill, image completion, and inpainting. In…
Last week, a blog post by an Uber engineer explained why Uber chose to move from PostgreSQL to MySQL . This article was widely reported and...
Uber provides bad advice about PostreSQL vs. MySQL
A detailed look at the interesting LSM file organisation seen in BigTable, Cassandra and most recently MongoDB.
Generalized linear models (GLMs) are indispensable tools in the data science toolbox. They are applicable to many real-world problems involving continuous, yes/no, count and survival data (and more). The models themselves are intuitive and can be used for inference and prediction. A few very high quality free and open…
This data sculpture depicts a map of housing prices in San Francisco. It's a map of the city, torn at the seams. The height of each area represents the average price per square foot for recent home sales. Where neighboring areas are close in value they are connected, but if neighboring areas are too far
Last week, Peter and I gave a tutorial at SciPy 2016. In keeping with our recent thinking about reproducibility and organization , the idea was to look at how some of the hard-won lessons and best practices from modern software engineering can be applied to data science work.
Previously in Jepsen , we discussed Redis . In this post, we’ll see MongoDB drop a phenomenal amount of data. See also: followup analyses of 2.6.7 and 3.4.0-rc3 .
So you know the Bayes rule. How does it relate to machine learning? It can be quite difficult to grasp how the puzzle pieces fit together - we know …
In the last Jepsen post, we found that RethinkDB could lose data when a network partition occurred during cluster reconfiguration. In this analysis, we’ll show that although VoltDB 6.3 claims strict serializability, internal optimizations and bugs lead to stale reads, dirty reads, and even lost updates; fixes are now…
In this tutorial we will learn about the concepts behind the SQL syntax. We will go through the basics of how to use the FROM and WHERE clauses, and move on to more advanced topics like joins, aggregations and subqueries.
Recently there has been a lot of development in realtime data processing systems, including Twitter's Storm and Heron, Google's Millwheel, a...
In the last Jepsen analysis, we saw that RethinkDB 2.2.3 could encounter spectacular failure modes due to cluster reconfiguration during a partition. In this analysis, we’ll talk about Crate, and find out just how many versions a row’s version identifies.
Alternatively titled ‘Be aware of context, and maybe start using Google AdWords’ Instead
I’ve come to the conclusion that, for me, ORMs are more detriment than benefit. In short, they can be used to nicely augment working with SQL in a program, but they should not replace it.
One day in January 2013 I found myself wasting time on the internet.
Yesterday at the WWDC keynote, Apple announced a series of new security and privacy features, including one feature that’s drawn a bit of attention — and confusion. Specifically, Apple …
I recently had to set up a new postgres instance at work. While we’re already using Heroku Postgres for production loads, we had some requirements for this one that couldn’t be solved without being database admin, and thus had to go self-hosted. That...