91
New
The latest blog posts to take off on Hacker News. 332 posts.
92
Wikipedia graph mining: dynamic structure of collective memory
Wikipedia graph dynamic pattern discovery. Dynamic graph analysis in GraphX. Collective memory research. Gephi graph visualization.
93
Visualizing Your Ruby Heap
In a previous post, I wrote a bit about how Ruby objects are laid out in memory. Today we’ll use that information to write a program that will allow us to take a Ruby heap dump and visualize the layout and fragmentation of that heap. Ruby Object Layout Recap Just as a recap, Ruby objects are fixed width. That is…
94
Stream VByte: breaking new speed records for integer compression
In many information systems, we work with arrays of integers. For example, maybe you need to keep track of which records in a database contain a given value. This sort of mapping can be expressed as an array of integers. These arrays can end up taking up a large fraction of your memory or disk … Continue reading…
95
On Disk IO, Part 3: LSM Trees
If you like the series, check out my book on Database Internals!
96
97
Open-Sourcing Vespa, Yahoo’s Data Processing and Serving Engine
Yahoo, the trusted guide for millions globally with iconic products for 30+ years—offers advertisers omnichannel solutions and powerful data to deliver results.
98
PostgreSQL's Hash Indexes Are Now Cool
Since I just committed the last pending patch to improve hash indexes to PostgreSQL 11, and since most of the improvements to hash indexes w...
99
When Citi Bikes Are Faster Than Taxis in New York City
Over 50% of peak hour taxi trips would be faster as Citi Bike rides, and taxis are only getting slower
100
Why SQL is beating NoSQL, and what this means for the future of data
After being left for dead, SQL is making a comeback and the NoSQL vs. SQL debate is stronger than ever. Why? And how will it impact the data community?
101
Apache Arrow and the “Things I Hate About Pandas”
This post is the first of many to come on Apache Arrow, pandas, pandas2, and the general trajectory of my work in recent times and into the foreseeable future. This is a bit of a read and overall fairly technical, but if interested I encourage you to take the time to work through it.
102
103
APFS – A Backup Software Developer’s Perspective
A backup-software developer's deep dive into Apple's APFS file system — snapshots, cloning, space sharing, and what it all means for reliable Mac backups.
104
105
Transactionally Staged Job Drains in Postgres
Building a robust background worker system that leverages transactional isolation to never work a job too early, and transactional durability to never let one drop.
106
Spaces: Scalable Object Storage on DigitalOcean
Helping millions of developers easily build, test, manage, and scale applications of any size - faster than ever before.
107
Index Investing Makes Markets and Economies More Efficient (2016)
U.S. equity index funds have grown dramatically in recent decades, from a negligible $500MM in assets in the early 1980s to a staggering $4T today. The consensus view in the investment community is that this growth is unsustainable. Indexing, after all, is a form of free-riding, and a market can only support so many…
108
Getting Started on Geospatial Analysis with Python, GeoJSON and GeoPandas
Learn to perform the basics of geospatial analysis using Python along with the GeoJSON and GeoPandas libraries.
109
Prime Day 2017: 12.9M DynamoDB requests per second
The third annual Prime Day set another round of records for global orders, topping Black Friday and Cyber Monday, making it the biggest day in Amazon retail history. Over the course of the 30 hour event, tens of millions of Prime members purchased things like Echo Dots, Fire tablets, programmable pressure cookers…
110
PostgreSQL 10 Beta 4 Released
The PostgreSQL Global Development Group announces today that the fourth beta release of PostgreSQL 10 is available for download. This …
111
Migrating from RethinkDB to Postgres – An Experience Report
Note: This post and our new engineering blog can be found at lumi.dev
112
InfluxDB now supports Prometheus remote reads and writes natively
We were inspired after Paul Dix, Co-Founder and CTO of InfluxData spoke at PromCon and received interest in more integration between Prometheus and InfluxDB. We are excited to introduce InfluxDB Prometheus Interoperability - InfluxDB 1.4, which now sup...
113
Most Female and Male Occupations Since 1950
The shifting majorities of the sexes in the workplace.
114
Better Database Migrations in Postgres
As your database grows and scales there are some operations that you need to take more care of than you did when you were just starting. When working with your application in your dev environment you may not be fully aware of the cost of some operations until you run them against production. And at some point most of…
115
House Address “Twins” Proximity
In a previous post, I did a bit of analysis of the names of towns and streets . However, that clearly wasn’t enough to sate my bizarre interest in all things address-based, so here I am again with more street-name-based nerdery.
116
117
How to Generate FiveThirtyEight Graphs in Python
Impressed by the graphs on popular site FiveThirtyEight? This quick tutorial gets you started making your own eye-catching visualizations.
118
Sorting number strings numerically
The only enterprise AI data platform that cuts complexity, reduces costs, and gets you to production faster.
119
Publishing with Apache Kafka at The New York Times
This post covers how Apache Kafka and its Streams API are used for storing and processing all the articles ever published by The New York Times
120