New
The latest blog posts to take off on Hacker News. 265 posts.
Faster R with FastR
R is a programming language for statistical computing known for its rich ecosystem of 3rd party libraries called “packages”. The R…
The hacker's guide to uncertainty estimates
I made a New Year's resolution: every plot I make during 2018 will contain uncertainty estimates. Nine months in and I have learned a lot, so I put together a summary of some of the most useful methods.
Using machine learning to index text from billions of images
Dash knows your context, your team, and your work, so your team can stay organized, easily find and share knowledge, and keep projects secure, all from one place.
SQL as an API language
Datasette (previously) is my open source tool for exploring and publishing structured data. There are a lot of ideas embedded in Datasette. I realized that I haven’t put many of …
Data Factories
Facebook and Google and other advertising businesses are data factories, and regulation will be most effective if it lets users look inside
Introducing Workers KV
In 1864 British computer pioneer Charles Babbage described the first key-value store to be used as part of his Analytical Engine.
Architecture of Nautilus, the new Dropbox search engine
Dash knows your context, your team, and your work, so your team can stay organized, easily find and share knowledge, and keep projects secure, all from one place.
How to visualize decision trees
Decision trees are the fundamental building block of gradient boosting machines and Random Forests(tm), probably the two most popular machine learning models for structured data. Visualizing decision trees is a tremendous aid when learning how these models work and when interpreting models. Unfortunately, current…
The design and implementation of modern column-oriented database systems
The design and implementation of modern column-oriented database systems Abadi et al., Foundations and trends in databases, 2012 I came here by following the references in the Smoke paper we looked…
Postgres 11 – A First Look
Postgres 11 is almost here, in fact the latest beta shipped today, and it features a lot of exciting improvements. If you want to get the full list of features it is definitely worth checking out the release notes, but for those who don’t read the release notes I put together a run down of some what I consider the…
NewSQL databases fail to guarantee consistency and I blame Spanner
(Spanner vs. Calvin, Part 2) [TL;DR I wrote a post in 2017 that discussed Spanner vs. Calvin that focused on performance differences. Th...
The DeWitt Clause: Why You Rarely See Database Benchmarks
Back in the early 1980s, Dr. David DeWitt – who you might know from past PASS Summit keynotes, formerly of Microsoft (LinkedIn) – was working on measuring database performance. His team wrote a benchmark, ran it against Oracle, and Oracle didn’t fare well in the results. Oracle reacted as one would expect – they were…
A Day in the Life of Americans
I wanted to see how daily patterns emerge at the individual level and how a person’s entire day plays out. So I simulated 1,000 of them.
First release candidate for TimescaleDB 1.0
Install TimescaleDB on Linux, macOS, Windows, Docker, Kubernetes, or from source
SQLite: Infinite loop due to the ‘order by limit’ optimization
Verify that you are human by typing in the 8-character text password shown below.
PostgreSQL 11 and Just in Time Compilation of Queries
PostgreSQL 11 includes a new component in the execution engine: a JIT expression compiler. A benchmark comparison shows up to 29.31% speed improvements in PostgreSQL 11 using the JIT expression compiler, executing TPC-H Q1 at scale factor 10 in 20.5s instead of 29s when using PostgreSQL 10.
Who Wrote the Anti-Trump New York Times Op-Ed? Using Tidytext
Like a lot of people, I was intrigued by “I Am Part of the Resistance Inside the Trump Administration”, an anonymous New York Times op-ed written by a “senior official in the Trump administration”. And like many data scientists, I was curious about what role text mining could play.
“Stateless” sync using version vectors
Isolating cloud sync and persistent storage in an app architecture.
Learning Python for Social Scientists (2015)
I’ve compiled a list of Python tutorials and annotated analyses. I've tried to list pages that are accessible to social scientists with little background in Python and/or machine learning.