New
The latest blog posts to take off on Hacker News. 1,888 posts.
Pev: Postgres ‘Explain’ Visualizer (2016)
Postgres Explain Visualizer (Pev) is a tool I wrote to make EXPLAIN output easier to grok. It creates a graphical representation of the query plan.
What Does It Take to Track a Million Cell Phones?
You can find anything and everything on the internet, yet nothing that explains how to track cell phones. Let us clarify right away, we are not talking about how to track your own cell phone in cas…
What is Eventual Consistency?
On this post we're going to talk about Eventual Consistency in the context of lock-free and wait-free data structures, with focus on the C++...
Datomic: this is not the history you're looking for
In this post, I'll describe some common pitfalls regarding the use of the 'time-travel' features of Datomic ( db.asOf() , db.history() , :db/txInstant ).
Postgres Job Queues and Failure by MVCC
How Postgres’ concurrency model coupled with long-lived transactions can degrade the performance of indexes on hot tables in your database.
Migration from Postgres to Datomic
Recently, I migrated my Clojure-driven pet project from PostgreSQL to Datomic. This is Queryfeed , a web application to fetch data from social networks. I’ve been running it for several years considering it as a playground for some experiments. Long ago, it was written in Python, then I ported it to Clojure.
Why Did So Many Startups Choose MongoDB?
NoSQL databases were the future. MongoDB was the database for “modern” web engineers and used by countless startups. What happened?
Effectively Using Matplotlib
Matplotlib is a valuable but misunderstood foundation of the python data science stack.
Literate SQL
Complex queries are hard to read. Literate SQL is about writing queries that are as easy to read as a good novel.
The Decline of Imgur on Reddit and the Rise of Reddit's Native Image Hosting
Before Reddit added native image hosting, Imgur accounted for 15% of all submissions to Reddit. Now it’s below 9%.
Z-order curve usage to decrease dimensionality to 1
Personal blog about system engineering and devops
Be Careful with UUID or GUID as Primary Keys
You can use of UUIDs as the primary key to avoid database scale problems. But should you? I propose an alternative.
Advantages of Using R Notebooks for Data Analysis Instead of Jupyter Notebooks
The relatively new R Notebooks improve the workflows of common data analysis in ways Jupyter Notebooks can’t.
Working with time in Postgres
A massive amount of reporting queries, whether really intensive data analysis, or just basic insights into your business involving looking at data over a certain time period. Postgres has really rich support for dealing with time out of the box, something that’s often very underweighted when dealing with a database…
Words growing or shrinking in Hacker News titles: a tidy analysis
In May, some friends and I built Tagger News, a real-time automatic classifier of Hacker News articles based on their text (see here for more about how we built it). This process started me down some interesting paths, particularly analyzing trends in titles. By finding words that became more or less common in Hacker…
Python For Finance: Algorithmic Trading
Originally published at https://www.datacamp.com/community/tutorials/finance-python-trading
Damn Cool Algorithms: Log structured storage (2009)
Typically, if you're designing a storage system - such as a filesystem, or a database - one of your major concerns is how to store the data on disk. You have to take care of allocating space for the objects to be stored, as well as storing the indexing data; you have to worry about what happens when you want to extend…
Mosaic: processing a trillion-edge graph on a single machine
Mosaic: Processing a trillion-edge graph on a single machine Maass et al., EuroSys’17 Unless your graph is bigger than Facebook’s, you can process it on a single machine. With the incep…
Improving Stack Overflow jobs search with machine learning and R
A journey into making Stack Overflow job search results relevant to you
Distributed Consensus – How Shared Data Is Stored
If you don’t work in computers, you probably haven’t spent much time thinking about how data gets stored on computers or in the cloud. I’m…
How Powerful Are Microsoft Azure’s Free Jupyter Notebooks?
For a while now, Microsoft have provided a free Jupyter Notebook service on Microsoft Azure. At the moment they provide compute kernels for Python, R and F# providing up to 4Gb of memory per sessio…