New
The latest blog posts to take off on Hacker News. 2,338 posts.
Tendermint 0.10.2
Tendermint is a server and a protocol for building linearizable (or sequentially consistent) byzantine fault-tolerant applications. Tendermint validators accept transactions from clients over HTTP, and replicate them to the other validators in the cluster, forming a totally ordered sequence of transactions. Each…
Free Data Recovery of Wet Phones and Hard Drives for Hurricane Harvey Victims
Visit our Press Release page to get more details concerning the latest as well as upcoming news in our DriveSavers company. Click here to read.
Databases and Distributed Deadlocks: A FAQ
A developer FAQ created by the Citus engineering team when they first began working on distributed deadlock detection in the Citus database. Explores when PostgreSQL acquires locks, when deadlocks occur, and how Citus detects and prevents distributed deadlocks in Postgres.
LogDevice: a distributed data store for logs
Visit the post for more.
Backblaze's Hard Drive Stats for Q2 2017
In this update, we’ll review the Q2 2017 and lifetime hard drive failure rates for all our current drive models including enterprise and consumers drives.
Sharding data models
At Citus we make it simple to shard PostgreSQL. So we’ve thought a lot about different data models for sharding. This post covers 5 different data models for sharding, from sharding by tenant (multi-tenant data models), sharding by geography, sharding by entity id, sharding a graph, and time-based partitioning.
KSQL: Open Source Streaming SQL for Apache Kafka
Introducing KSQL, a streaming SQL engine for Apache Kafka. KSQL provides a simple and completely interactive SQL interface for processing data in Kafka.
YC Summer 2017 Stats
Today is Y Combinator’s 25th Demo Day. With 124 companies presenting over the next two days, this is the largest Demo Day in YC’s 12.5 year history. We wanted to share some stats about YC and about the batch. For the more visually inclined, see the graphic below created by YC alum SketchDeck…
Postgres geography type is not limited to Earth
It's a little known fact that the PostGIS geography type since PostGIS 2.2 (well was introduced in 2.1 I think but had a bug in it until 2.1.4 or so), supports any spheroidal spatial reference system that measures in degrees. When an srid is not specified, it defaults to using 4326, Earth WGS 84 long lat.
Introducing WAL-G: Faster Disaster Recovery for Postgres
A key part of running a reliable database as a service is ensuring you have a good plan for disaster recovery. This post introduces WAL-G, the successor to WAL-E for Postgres, a complete rewrite of WAL-E that provides the same functionality plus 4x faster restores on recovery.
The HDFS Juggernaut
There's been much focus on MongoDB, Elastic and Redis in terms of data exposure on the Internet due to their general popularity in the developer community. However, in terms of data volume it turns out that HDFS is the real juggernaut. To give you a better idea here's a quick
Macie: Automatically Discover, Classify, and Secure Content at Scale
This blog is out of date. Please refer here for the updated info. When Jeff and I heard about this service, we both were curious on the meaning of the name Macie. Of course, Jeff being a great researcher looked up the name Macie and found that the name Macie has two meanings. It has […]
Implementing Backup
How we implemented consistent, distributed, incremental backup in CockroachDB.
Principles of Sharding for Relational Databases
Some say sharding is the best way to scale a database. Sharding enables you to linearly scale cpu, memory, and disk by separating your database into smaller parts. Yet, sharding is controversial. This post explores the principles of sharding relational databases for B2B, B2C, and B2B2C applications.
What's so hard about histograms?
An interactive essay on the joys and pitfalls of histograms
ArangoDB 3.2 GA RocksDB, Pregel, Fault-Tolerant Foxx and Satellite Collections
The only enterprise AI data platform that cuts complexity, reduces costs, and gets you to production faster.
Announcing RethinkDB 2.3.6: the first release under community governance
We’re pleased to announce the availability of RethinkDB 2.3.6, the first release since RethinkDB transitioned to community governance. This update includes a range of bugfixes and stability improvements. For a complete list of changes in this update, you can refer to the release notes .
Lessons learned teaching data analysis with Python
A San Diego State journalism professor shares her experience with “First Python Notebook”
Getting Started with Event Sourcing in Postgres
In a previous post we explored how our application tracks sent emails. We set things up to update or insert a record for each email with the current state (delivered, dropped, etc). In this post we'll look at an alternative data model where we'll store each event as its own record and then roll up t
Hard Drive Cost per Gigabyte
For hard drive prices, the race to zero is over: nobody won. As you’ll see, the hard drive pricing curve has flattened out.