241
Hard Drive Stats for 2019
In 2019 we monitored the performance of 122,507 hard drives. In this article we look at the failure rates by make and model.
New
The latest blog posts to take off on Hacker News. 269 posts.
242
A popular self-driving car dataset is missing labels for hundreds of pedestrians
SUMMARY A hand-check of the 15,000 images in the widely used Udacity Dataset 2 found problems in 4,986 of them (33%), including thousands of unlabeled vehicles, hundreds of unlabeled pedestrians, dozens of unlabeled cyclists, and 217 completely unannotated images that contained real objects. Phantom annotations…
243
Diffing Coronaviruses
Comparing the genome sequences of the Wuhan coronavirus and a bat coronavirus using `diff` and NCBI BLAST reveals an 89% similarity.
244
Migrating to CockroachDB
CockroachDB is a newSQL database, behaving much like a traditional database while providing consistent HA and scalability out of the box.
245
Null Values in SQL Queries
*If you’re the owner of this website and have questions, reach out to Bluehost. We’re happy to help.
246
Streaming: a skill gap?
It's not just for big data
247
Jepsen: Etcd 3.4.3
The etcd key-value store is a distributed system intended for use as a coordination primitive. Like Zookeeper and Consul , etcd stores a small volume of infrequently-updated state ( by default, up to 8 GB ) in a key-value map, and offers strict-serializable reads, writes and micro-transactions across the entire…
248
The Rise of SQL-Based Data Modeling
The resurgence of SQL-based data modeling is a something we should all be interested in. Here's why it's important.
249
Command-line tools can be faster than a Hadoop cluster (2014)
Adam Drake is an advisor to scale-up tech companies. He writes about ML/AI/data, leadership, and building tech teams.
250
Pandas 1.0
These are the changes in pandas 1.0.0. See Release notes for a full changelog including other versions of pandas.
251
Why ZFS is not good at growing and reshaping pools, or shrinking them
You're probably reading this page because you've attempted to access some part of my blog (Wandering Thoughts) or CSpace , the wiki thing it's part of. Unfortunately you're using a browser version that my anti-crawler precautions consider suspicious, most often because it's too old (most often this applies to versions…
252
253
254
SQLite Is Serverless
Most SQL database engines are implemented as a separate server process. Programs that want to access the database communicate with the server using some kind of interprocess communication (typically TCP/IP) to send requests to the server and to receive back results. SQLite does not work this way. With SQLite, the…
255
Discovering Millions of Datasets on the Web
Dataset Search launches publicly with an index of 25 million datasets, helping scientists, journalists, students, data geeks to find data.
256
Fixing Google Map Transit Feed Mistakes in Taiwan
Probably one of the nerdier things I do in my free time is fix and report transit errors on Google Maps. Accurate transit directions and schedules are extremely important if we want more people to take transit more often, especially in scenarios where good transit options exist! I do these bug reports and the…
257
How to Corrupt a SQLite Database File
An SQLite database is highly resistant to corruption. If an application crash, or an operating-system crash, or even a power failure occurs in the middle of a transaction, the partially written transaction should be automatically rolled back the next time the database file is accessed. The recovery process is fully…
258
Analysis of compensation, level, and experience details of 19k tech workers
[Twitter thread, Hacker News discussion, Reddit discussion]
259
Effectively Using Materialized Views in Ruby on Rails
We look at how to utilize both, views and materialized views, within Ruby on Rails with a real-world sized dataset of hockey teams and their top scorers.
260
Rust DataBase Connectivity (RDBC)
Software engineer specializing in query engines and distributed systems
261
Bay Area Regional GTFS Feed: 31 transit agency feeds together in one API
Last year, Interline began a "startup in residence" at the Metropolitan Transportation Commission. Now we're pleased to publicly release our first creation: the San Francisco Bay Area's Regional GTFS Feed.
262
Finding unique items: hash vs. sort
A while back, I was trying to speed up some code which finds unique items in a collection. For example, transforming "AABBADCAB" => "ABDC" . There are two ways to do this efficiently - one is based on sorting, the other based on hashing. So, which is faster? I couldn't find the answer, so I ran some experiments and…
263
Flyte: A Cloud Native Machine Learning and Data Processing Platform
Today Lyft is excited to announce the open sourcing of Flyte, a structured programming and distributed processing platform for highly…
264
ClickHouse cost-efficiency in action: analyzing 500B rows on an Intel NUC
See how ClickHouse delivers faster query performance on 500 billion rows of data compared to ScyllaDB, leveraging an Intel NUC mini PC, advanced compression, and materialized views.
265
266
Serving Dynamic Vector Tiles from PostGIS
Guide to building up a tile server and map client from scratch with PostGIS and PostgreSQL.
267
Elasticsearch from the Bottom Up (2013)
In this article series, we look at Elasticsearch from a new perspective. We'll start at the 'bottom' (or close enough!) of the many abstraction levels, and gradually move upwards towards the user-visi...
268
Event Sourcing (2017)
I recently became intrigued by the concept of event sourcing as applied to back-end architecture, specifically a microservice-oriented approach. I have spent the last few years working predominantly on the front-end, and became enamored by the simplicity and elegance of this pattern as the backbone of front-end…
269
The Economics of Building Knowledge Bases
During the summers of my high school years in suburban Georgia, my friend and I would fill the time by randomly walking into local establishments asking for odd jobs. It was a great way as a studen…