Hard Drive Stats for 2019
In 2019 we monitored the performance of 122,507 hard drives. In this article we look at the failure rates by make and model.
The latest blog posts to take off on Hacker News. 2,337 posts.
In 2019 we monitored the performance of 122,507 hard drives. In this article we look at the failure rates by make and model.
SUMMARY A hand-check of the 15,000 images in the widely used Udacity Dataset 2 found problems in 4,986 of them (33%), including thousands of unlabeled vehicles, hundreds of unlabeled pedestrians, dozens of unlabeled cyclists, and 217 completely unannotated images that contained real objects. Phantom annotations…
The etcd key-value store is a distributed system intended for use as a coordination primitive. Like Zookeeper and Consul , etcd stores a small volume of infrequently-updated state ( by default, up to 8 GB ) in a key-value map, and offers strict-serializable reads, writes and micro-transactions across the entire…
The resurgence of SQL-based data modeling is a something we should all be interested in. Here's why it's important.
These are the changes in pandas 1.0.0. See Release notes for a full changelog including other versions of pandas.
Most SQL database engines are implemented as a separate server process. Programs that want to access the database communicate with the server using some kind of interprocess communication (typically TCP/IP) to send requests to the server and to receive back results. SQLite does not work this way. With SQLite, the…
Dataset Search launches publicly with an index of 25 million datasets, helping scientists, journalists, students, data geeks to find data.
An SQLite database is highly resistant to corruption. If an application crash, or an operating-system crash, or even a power failure occurs in the middle of a transaction, the partially written transaction should be automatically rolled back the next time the database file is accessed. The recovery process is fully…
We look at how to utilize both, views and materialized views, within Ruby on Rails with a real-world sized dataset of hockey teams and their top scorers.
Last year, Interline began a "startup in residence" at the Metropolitan Transportation Commission. Now we're pleased to publicly release our first creation: the San Francisco Bay Area's Regional GTFS Feed.
Today Lyft is excited to announce the open sourcing of Flyte, a structured programming and distributed processing platform for highly…
See how ClickHouse delivers faster query performance on 500 billion rows of data compared to ScyllaDB, leveraging an Intel NUC mini PC, advanced compression, and materialized views.
Guide to building up a tile server and map client from scratch with PostGIS and PostgreSQL.
In this article series, we look at Elasticsearch from a new perspective. We'll start at the 'bottom' (or close enough!) of the many abstraction levels, and gradually move upwards towards the user-visi...
During the summers of my high school years in suburban Georgia, my friend and I would fill the time by randomly walking into local establishments asking for odd jobs. It was a great way as a studen…
Estimating expected time of arrival (ETA) is crucial to what we do at Lyft. Estimates go directly to riders and drivers using our apps, as…
TiDB is the distributed SQL database built for AI agents. Vectors, transactions, and analytics in one engine with ACID guarantees and elastic scale.
The cover image is based on Jupiter family by NASA/JPL.
We explore how databases be used as effective Pub/Subs in Go, demonstrating how SQL's unique features can enhance message-driven applications.
What is a predictive database? A database that lets you query predictions from structured tabular data with no model training step. Learn how predictive databases work, when to use them, and how they compare to traditional ML.
The Eventide Project team is excited to announce Message DB: A fully-featured event store and message store implemented in PostgreSQL for pub/sub, event sourcing, and evented microservices applicat...
The 2020 Cloud Report compares AWS, GCP, and Azure on microbenchmarks and customer-like-workloads to understand performance tradeoffs within each cloud.
Did you ever imagine that an “Ice Cream” could shake the entire General Motors? In 2010, the Pontiac Division of General Motors received a very funny complaint from one of its customers. It was so weird & bizarre that it took the entire General Motors by storm. However, on reading the entire Case, this definitely
As part of the fastMRI research project to use AI to speed up MRI scans, NYU Langone Health is making a new dataset of de-identified brain MRIs available to researchers and Facebook AI is sharing additional tools and resources.
When computer vision detectors are turned loose in the real world, their performance noticeably drops. In an effort to close this performance gap, a team of MIT and IBM researchers set out to create a very different kind of object-recognition dataset called ObjectNet.
In this post I'm going to show you a simple way to significantly speedup Python numpy compute performance on AMD CPU's when using Anaconda Python.