Every NFL play for the past 10 years in CSV format
I've recently completed a project to compile publicly-available NFL play-by-play data. It took a while, but now it's ready. The resulting ...
The latest blog posts to take off on Hacker News. 1,888 posts.
I've recently completed a project to compile publicly-available NFL play-by-play data. It took a while, but now it's ready. The resulting ...
Having seen this failure mode happen a couple times now, it's time to share. Yes, Virgil, multi-disk failures DO happen during RAID rebuilds. I have pictures, so it MUST be true!First,
Thoughts about why relational databases are not a bad choice when starting a new project.
I've been impressed in recent months by the number and quality of free datascience/machine learning books available online. I don't mean fre...
In 2010ish, we tried to roll out a feature ( Treasury ) using MongoDB. It was an interesting experience. I learned quite a bit in the process. I wrote about what I was thinking at the time here . But for the most part it was an abject failure and Ryan Young wound up porting the entire thing to the MySQL shards which…
How I made $500k from high frequency trading using machine learning to optimize a trading algorithm for Russell 2000 and DAX futures, trading independently without working for a quant firm.
I use about.me to show people what matters most to me.
I recommend using Python for data analysis, and I recommend Wes McKinney's book Python for Data Analysis. I prefer Python to R for mathematical computing because mathematical computing doesn't exist in a vacuum; there's always other stuff to do. I find doing mathematical programming in a general-purpose language is…
I'm working on a little photography website for my Dad and thought it would be neat to extract color information from photographs. I tried a couple of different approaches before finding one that works pretty well. This approach uses k-means clustering to cluster the pixels in groups based on their color. The center…
I’ve used MongoDB for over a year at scale at both Heyzap and Bugsnag and I’ve found it to be a very capable database. As with all databases, there are some gotchas, and here is a summary of the things I wish someone had told me earlier.
This afternoon, I looked at the source of the main Google page with my browser. It spans my whole monitor and takes 15 pushes of the scroll-wheel to see it all. Whither minimalism? Off to the Wayba…
Update theres a more recent post that expands further on where to start optimizing specific queries, and of course if you want to dig into optimizing your infrastructure High Performance PostgreSQL is still a great read For many application developers their database is a black box. Data goes in, comes back out and in…
A few weeks ago I wrote a small app that fetches JSON documents from app.net’s API and draws a word cloud . At first I wasn’t keeping the content around after generating the images. Later I thought of other things I’d like to do with the documents, so I decided to start storing them.
So today, I was buzzing around and searching for a `countries` table script that I could use in MySQL database. As you can imagine, it wouldn’t make any sense to add all world countries into …
Every time we see people look at PostgreSQL and MySQL on the internet it falls into a flame war fast. I think that a large part of the pr...
Posted by Nick Johnson | Filed under python , cardinality-estimation , damn-cool-algorithms
99Bitcoins is your trusted guide to Bitcoin & crypto, offering easy tutorials, expert insights, and in-depth reviews to help you navigate the crypto world.
Steve Huffman talks about Reddit’s approach to data storage in a High Scalability post from 2010. I was surprised to learn that they only have two tables in their database.
Shortly after I started Per Square Mile, I produced an infographic that showed how big a city would have to be to house the world’s 7 billion people.
Wolfram|Alpha analyzes your Facebook data for free. Compute statistics: posting activity, most liked post, words most used, friends' geography, age and genders... more than a dozen reports.