New
The latest blog posts to take off on Hacker News. 1,888 posts.
Nonnegative matrix factorization
The why and how of nonnegative matrix factorization Gillis, arXiv 2014 from: ‘Regularization, Optimization, Kernels, and Support Vector Machines.’ Last week we looked at the paper ‘Beyond news cont…
PostgreSQL 11 Reestablishes Window Functions Leadership
PostgreSQL 11 offers the best OVER clause support among its competitors, true procedures, and improvements in FETCH FIRST and XML.
Event Sourcing is Hard
Despite it being sold as the one true path, event sourcing comes with some pain points when you try to put its ideas into production.
The potential risk to ZFS created by the shift in its userbase
You're probably reading this page because you've attempted to access some part of my blog (Wandering Thoughts) or CSpace , the wiki thing it's part of. Unfortunately you're using a browser version that my anti-crawler precautions consider suspicious, most often because it's too old (most often this applies to versions…
It’s Time to Move on from Two Phase Commit
The two-phase commit protocol (2PC) has been used in enterprise software systems for over three decades . It has been an an incredibly impa...
Kyoto Tycoon in 2019
I've been interested in using Kyoto Tycoon for some time. Kyoto Tycoon, successor to Tokyo Tyrant , is a key/value database with a number of desirable features:
A Primer on Database Replication (2017)
A Primer on Database Replication
What Kagglers Are Using for Text Classification
With the problem of Image Classification is more or less solved by Deep learning, Text Classification is the next new developing theme in deep learning. For those who don’t know, Text classification is a common task in natural language processing, which transforms a sequence of text of indefinite length into a…
Text Matching Using Cosine Similarity
Recently I was working on a project where I have to cluster all the words which have a similar name. For a novice it looks a pretty simple job of using some Fuzzy string matching tools and get this done. However in reality this was a challenge because of multiple reasons starting from pre-processing of the data to…
Why everything you have said about the determinants of health expenditure is wrong in one million charts: a response to Noah Smith.
Household income determines health spending, mostly via higher intensity, not prices. US behaviors are consistent with well-measured income in multiple dimensions.
Two-phase commit and beyond
In this post, we model and explore the two-phase commit protocol using TLA+. The two-phase commit protocol is practical and is used in man...
Using data to determine if Die Hard is a Christmas movie
Ok, enough bickering and fighting.
Congress votes to make open government data the default in the United States
On December 21, 2018, the United States House of Representatives voted to enact H.R. 4174, the Foundations for Evidence-Based Policymaking Act of 2017, in a historic win for open government in the …
How Google Code Search Worked: Regex Matching with a Trigram Index (2012)
In the summer of 2006, I was lucky enough to be an intern at Google. At the time, Google had an internal tool called gsearch that acted as if it ran grep over all the files in the Google source tree and printed the results. Of course, that implementation would be fairly slow, so what gsearch actually did was talk to a…
Pythran as a bridge between fast prototyping and code deployment
As a researcher/engineer (really, an algorithm developer) in the general area of audio and speech processing, I've always run into the same difficulty at all the companies I've worked at: How to quickly prototype and develop algorithms, and subsequently turn them into efficient code that can be deployed to customers.
Estimating the chances of something that hasn’t happened yet
A handy rule of thumb for creating a confidence interval for the probability of an event you haven't seen happen yet.
Fun with NFL Stats, Bokeh, and Pandas
An exploration of NFL play-by-play statistics with Bokeh and Pandas.
Datomic: Event Sourcing without the hassle
When I got started using the Datomic database, I remember someone describing it to me as 'Event Sourcing without the hassle'. Having built Event Sourcing systems both with and without Datomic, I think this is very well put, although it might not be obvious, especially if you don't have much experience with Datomic.
Visualizing SQL Plan Execution Time with FlameGraphs
Update: I wrote a follow-up article about adding Loop Counters and Row Counts to SQL Plan FlameGraphs. I also show some old examples of “Bookshelf Graph” visualizations there. Check it out after reading this post first. Introduction Brendan Gregg invented and popularized a way to profile & visualize program response…
A Gentle Visual Intro to Data Analysis in Python Using Pandas
Discussions: Hacker News (195 points, 51 comments), Reddit r/Python (140 points, 18 comments) If you’re planning to learn data analysis, machine learning, or data science tools in python, you’re most likely going to be using the wonderful pandas library. Pandas is an open source library for data manipulation and…