New
The latest blog posts to take off on Hacker News. 1,888 posts.
Why Are Geospatial Databases So Hard to Build?
In 2005, I decided to design my first geospatial database engine. PostGIS was unable to keep up with the modest volumes of sensor data I was working with and while I was new to geospatial data, I had skill designing database engines. It seemed simple enough to get the scale and performance I required. Nothing could…
Catena: A time series storage engine written in Go
First, I suggest reading Baron’s “Time-Series Database Requirements” blog post to get some more context for this post. I read that and, as I usually do, had my mind set on low-level thoughts. I wrote the following comment:
Understanding Variance, Co-Variance, and Correlation
An explanation of Variance, Covariance and Correlation in rigorous yet clear terms providing a more general and intuitive look at these essential concepts.
IBash Notebook
Did you know that there's a Bash kernel for IPython Notebook? It even displays inline images. Could it ever be a convenient environment for doing data science? Would it be worthwhile to publish my book Data Science at the Command Line as a collection of notebooks?
What interests Reddit? A network analysis of 84M comments by 200K users
Reddit.com is a popular social media and news aggregation site. Here I analyze over 80 million comments by 200K redditors to discover what topics interest them.
Asynchronous Python and Databases
To quote the last part of this blog post, "I think it's [asyncio] really well done, it's fun to use, and I still am interested in having more of a SQLAlchemy story for it, because I'm sure folks will still want this no matter what anyone says.". To that end, SQLAlchemy 1.4 now includes complete support for asyncio …
Which topics get the upvote on Hacker News?
Hacker News is a popular social news website, mostly covering technology and startup topics. It relies on user submissions and moderation, where each submitted story can be upvoted and commented by users, which in term determines whether the story reaches the front page and how long it stays there.
84% of a single-threaded 1KB write in Redis is spent in the kernel
Alex Clemmer is a computer programmer. Other programmers love Alex, excitedly describing him as "employed here" and "the boss's son".
Practical Data Science in Python
Find, classify and remediate PII across your files, email, databases and cloud. Accurate AI-powered PII discovery – on-premise or SaaS.
Surviving Data Science at the Speed of Hype
john-foreman.com is your first and best source for information about john foreman. Here you will also find topics relating to issues of general interest. We hope you find what you are looking for!
Command-line tools can be faster than your Hadoop cluster
Adam Drake is an advisor to scale-up tech companies. He writes about ML/AI/data, leadership, and building tech teams.
Quantifying the Clickbait and Linkbait in BuzzFeed Article Titles
You probably do not know that the 3 most interesting things I found will blow your mind.
The Perilous World of Machine Learning for Fun and Profit
john-foreman.com is your first and best source for information about john foreman. Here you will also find topics relating to issues of general interest. We hope you find what you are looking for!
Multidimensional analysis of plot arcs in thousands of TV and movie scripts
Note: a somewhat more complete and slightly less colloquial, but eminently more citeable, version of this work is in the Proceedings of the ...
Average IQ of students by college major and gender ratio
Randy Olson charts out the IQ of students by their major's gender ratio and reveals a startling trend.
The R language, for programmers
Some things about the R programming language that programmers coming from other languages are likely to trip over.
What's wrong with statistics in Julia?
Introduction Link to heading Several months ago, I promised to write an updated version of my old post, “The State of Statistics in Julia”, that would describe how Julia’s support for statistical computing has evolved since December 2012. I’ve kept putting off writing that post for several reasons, but the most…
Hermitage: Testing the “I” in ACID
tl;dr: I have created a test suite for comparing the transaction isolation levels in different databases. I did this as background research for my book . This post explains why.
Starting data analysis with R: Things I wish I'd been told
R is a very powerful open source environment for data analysis, statistics and graphing, with thousands of packages available. After my previous blog post about likert-scales and metadata in R , a few of my colleagues mentioned that they were learning R through a Coursera course on data analysis . I have been working…