New
The latest blog posts to take off on Hacker News. 332 posts.
Tendermint 0.10.2
Tendermint is a server and a protocol for building linearizable (or sequentially consistent) byzantine fault-tolerant applications. Tendermint validators accept transactions from clients over HTTP, and replicate them to the other validators in the cluster, forming a totally ordered sequence of transactions. Each…
Free Data Recovery of Wet Phones and Hard Drives for Hurricane Harvey Victims
Visit our Press Release page to get more details concerning the latest as well as upcoming news in our DriveSavers company. Click here to read.
Tesla Model S battery degradation data
Want to read about the acceleration we are seeing in our society in the area of mobility? Read our new book ‘Forward’. Updated June 9, 2020. Today, Tesla Motors published their 2019 Imp…
Databases and Distributed Deadlocks: A FAQ
A developer FAQ created by the Citus engineering team when they first began working on distributed deadlock detection in the Citus database. Explores when PostgreSQL acquires locks, when deadlocks occur, and how Citus detects and prevents distributed deadlocks in Postgres.
LogDevice: a distributed data store for logs
Visit the post for more.
Restic Cryptography
tl;dr: this is not an audit and I take no responsibility for your backups, but I had a quick look at the crypto and I think I’m going to use restic for my personal backups.
Backblaze's Hard Drive Stats for Q2 2017
In this update, we’ll review the Q2 2017 and lifetime hard drive failure rates for all our current drive models including enterprise and consumers drives.
The Marketing Behind MongoDB
Countless NoSQL databases competed to be the database of choice. MongoDB's marketing strategy helped it become the winner.
Sharding data models
At Citus we make it simple to shard PostgreSQL. So we’ve thought a lot about different data models for sharding. This post covers 5 different data models for sharding, from sharding by tenant (multi-tenant data models), sharding by geography, sharding by entity id, sharding a graph, and time-based partitioning.
KSQL: Open Source Streaming SQL for Apache Kafka
Introducing KSQL, a streaming SQL engine for Apache Kafka. KSQL provides a simple and completely interactive SQL interface for processing data in Kafka.
YC Summer 2017 Stats
Today is Y Combinator’s 25th Demo Day. With 124 companies presenting over the next two days, this is the largest Demo Day in YC’s 12.5 year history. We wanted to share some stats about YC and about the batch. For the more visually inclined, see the graphic below created by YC alum SketchDeck…
Analyzing Cryptocurrency Markets Using Python
A data-driven approach to cryptocurrency (Bitcoin, Ethereum, Litecoin, Ripple etc.) market analysis and visualization using Python.
Postgres geography type is not limited to Earth
It's a little known fact that the PostGIS geography type since PostGIS 2.2 (well was introduced in 2.1 I think but had a bug in it until 2.1.4 or so), supports any spheroidal spatial reference system that measures in degrees. When an srid is not specified, it defaults to using 4326, Earth WGS 84 long lat.
Introducing WAL-G: Faster Disaster Recovery for Postgres
A key part of running a reliable database as a service is ensuring you have a good plan for disaster recovery. This post introduces WAL-G, the successor to WAL-E for Postgres, a complete rewrite of WAL-E that provides the same functionality plus 4x faster restores on recovery.
How Postgres Makes Transactions Atomic
A dive into the mechanics that allow Postgres to provide strong atomic guarantees despite the chaotic entropy of production.
Migrating 1200 databases from MySQL to Postgres
Once Upon a Time there was a company called Base7Booking that by the beginning of 2016 it was supporting around 1200 databases on MySQL 5...
The HDFS Juggernaut
There's been much focus on MongoDB, Elastic and Redis in terms of data exposure on the Internet due to their general popularity in the developer community. However, in terms of data volume it turns out that HDFS is the real juggernaut. To give you a better idea here's a quick
Plans for partitioning in PostgreSQL v11
The reaction to the new table partitioning feature in PostgreSQL 10 has been overwhelmingly positive, but a number of people have already as...
Macie: Automatically Discover, Classify, and Secure Content at Scale
This blog is out of date. Please refer here for the updated info. When Jeff and I heard about this service, we both were curious on the meaning of the name Macie. Of course, Jeff being a great researcher looked up the name Macie and found that the name Macie has two meanings. It has […]
Implementing Backup
How we implemented consistent, distributed, incremental backup in CockroachDB.
Principles of Sharding for Relational Databases
Some say sharding is the best way to scale a database. Sharding enables you to linearly scale cpu, memory, and disk by separating your database into smaller parts. Yet, sharding is controversial. This post explores the principles of sharding relational databases for B2B, B2C, and B2B2C applications.