New
The latest blog posts to take off on Hacker News. 106 posts.
Natural Language Corpus Data: Beautiful Data
Data files are derived from the Google Web Trillion Word Corpus , as described by Thorsten Brants and Alex Franz, and distributed by the Linguistic Data Consortium.
Analysis of longevity of code across many popular projects
As a project evolves, does the new code just add on top of the old code? Or does it replace the old code slowly over time? In order to understand this, I built a little thing to analyze Git projects, with help from the formidable GitPython project.
Finding the genre of a song with Deep Learning
A step-by-step guide to make your computer a music expert.
Visualizing How Developers Rate Their Own Programming Skills
As it turns out, there is no correlation between programming ability and the frequency of Stack Overflow visits.
Top Books on Amazon Based on Number of HN Users Linking Them in Comments
This visualization shows the top 29 books ranked by the number of unique users linking to corresponding Amazon pages in Hacker News comments from Oct 2006 to Oct 2015.
Statistical Mistakes and How to Avoid Them
You can get CS papers published with shoddy statistics, but that doesn’t mean you should. Here are three easy ways to bungle the data analysis in your evaluation section: don’t even try to use statistics when you really ought to; misinterpret an inconclusive statistical test as concluding a negative; or run too many…
What Percent of the Top-Voted Comments in Reddit Threads Were Also First Comment?
Are commenters ’late to this thread’ indeed late?
Ways Data Projects Fail
Introduction Data science continues to generate excitement and yet real-world results can often disappoint business stakeholders. How can we mitigate risk and ensure results match expectations? Working as a technical data scientist at the interface between R&D and commercial operations has given me an insight into the…
A Tour of Python’s Data Visualization Landscape, Including Ggplot and Altair
Why Even Try, Man? I recently came upon Brian Granger and Jake VanderPlas’s Altair, a promising young visualization library. Altair seems well-suited to addressing Python’s ggplot …
Analyzing the Patterns of Numbers in 10M Passwords (2015)
There are many patterns for numbers in passwords, which involve surprising yet intuitive logic.
Data Mining Hacker News: Front vs. Back
Using Haskell, R, Python, SQLite, and Elasticsearch, we data mine Hacker News front page stories and their back page counterparts for patterns.
Deep-Fried Data
This is the text version of a talk I gave on September 27, 2016, at the Collections as Data event at the Library of Congress. [ video ] (21 mins)
Reasons to choose PostgreSQL 9.6
PostgreSQL 9.6 was released a few days ago and it’s another huge milestone for the PostgreSQL community ! The release notes are way too long, so I’ve decided to pick up 6 big improvements that may change the way you will use PostgreSQL.
Postgres full-text search is Good Enough (2015)
When you have to build a web application, you are often asked to add search. The magnifying glass is something that we now add to wireframes without even knowing what we are going to search.
Audio Fingerprinting with Python and Numpy (2013)
Personal Blog of Will Drevo
The Simpsons by the Data
Analysis of Simpsons characters, dialogue, TV ratings, and more
GpuScan and SSD-To-GPU Direct DMA
An article for none-Japanese readers....What I'm recently working on is a feature to load data blocks from NVMe-SSD to GPU using peer-to-peer DMA. It allows to bypass the CPU/RAM under a series of data loading process, thus, also allows to reduce number of expensive data copy. Once data blocks are l…
Things I Hate About PostgreSQL (2013)
PostgreSQL Talk
Extracting data from Wikipedia using curl, grep, cut and other bash commands
By using a combination of curl, grep, cut, sort, uniq and other common bash utilities it is possible to extract structured data from Wikipedia and compute insights without writing a full program.
Extracting city blocks from OpenStreetMap data
Extracting blocks within a city as GeoJSON polygons from OpenStreetMap data
Image Completion with Deep Learning in TensorFlow
Content-aware fill is a powerful tool designers and photographers use to fill in unwanted or missing parts of images. Image completion and inpainting are closely related technologies used to fill in missing or corrupted parts of images. There are many ways to do content-aware fill, image completion, and inpainting. In…
Uber's Move Away from PostgreSQL
Last week, a blog post by an Uber engineer explained why Uber chose to move from PostgreSQL to MySQL . This article was widely reported and...