New
The latest blog posts to take off on Hacker News. 4,224 posts.
Spanner: TrueTime and external consistency
Understand Spanner's TrueTime and external consistency, ensuring globally consistent reads and writes across the distributed database.
Amazon DynamoDB Update – Global Tables and On-Demand Backup
AWS customers in a wide variety of industries use Amazon DynamoDB to store mission-critical data. Financial services, commerce, AdTech, IoT, and gaming applications (to name a few) make millions of requests per second to individual tables that contain hundreds of terabytes of data and trillions of items, and count on…
AWS AppSync – Build data-driven apps with real-time and off-line capabilities
September 8, 2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. In this day and age, it is almost impossible to do without our mobile devices and the applications that help make our lives easier. As our dependency on our mobile phone grows, the mobile application market has…
How Citus Executes Distributed Transactions on Postgres
Distributed transactions are one of the meanest, baddest problems in relational databases. This post explains why distributed transactions are hard and how the Citus database supports distributed transactions by employing features like distributed deadlock detection, 2PC, and streaming replication in Postgres.
TensorFlow Feature Columns
Welcome to Part 2 of a blog series that introduces TensorFlow Datasets and Estimators. We're devoting this article to —a data structure describing the features that an Estimator requires for training and inference. As you'll see, feature columns are very rich, enabling you to represent a diverse range of data.
Switching Jobs
When people move to different jobs, here’s where they go.
Scaling Postgres with Read Replicas and Using WAL to Counter Stale Reads
Scaling out operation with read replicas and avoiding the downside of stale reads by observing replication progress.
Monotonicity Types: Towards a Type System for Eventual Consistency
A few weeks back, we published a draft of an article entitled _Monotonicity Types_. In it, we describe a type system which we hope can aid the design of distributed systems by tracking monotonicity with types....
ZFS from a MySQL perspective
As the purpose of a database system is to store data, there is close relationship with the filesystem. Yves Trudeau reconsiders the use of ZFS with MySQL.
Citus Cloud 2, Postgres, and Scaling Without Compromise
Relational databases have been a mainstay for decades. But what happens when you need to scale out a relational database like Postgres? This post announces Citus Cloud 2, the latest version of the Citus managed database as a service that scales out Postgres horizontally in the cloud.
Elasticsearch 6.0.0 GA released
With 2236 pull requests by 333 commiters added since the release of Elasticsearch 5.0.0, we are proud to announce the release of Elasticsearch 6.0.0 GA, based on Lucene 7.0.1.
1.1B Taxi Trips on BrytlytDB 2.0
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
A/B test of banner ads vs. traffic
9 months of daily A/B-testing of Google AdSense banner ads on Gwern.net indicates banner ads decrease total traffic substantially, possibly due to spillover effects in reader engagement and resharing.
How should you build a high-performance column store for the 2020s?
Though most relational databases (like MySQL) are "row oriented", in that they keep rows stored together... experience has taught us that pivoting the data arrow so that columns, and not rows, are stored together can be beneficial. This is an old observation that most experienced programmers know about as the…
Creating a Modern OCR Pipeline Using Computer Vision and Deep Learning
Dash knows your context, your team, and your work, so your team can stay organized, easily find and share knowledge, and keep projects secure, all from one place.
Redis Streams and the Unified Log
Building a log-based architecture that’s fast, efficient, and resilient on the new stream data structure in Redis.
Cloud SQL for PostgreSQL adds high availability and replication
Cloud SQL for PostgreSQL users, we heard you loud and clear, and added support for high availability (HA) and read replicas, helping you ensure your database workloads are fault tolerant.
What it means to be a Postgres extension
Because Citus is an extension to PostgreSQL and not a fork, the effort required to remain compatible with the latest versions of the open source PostgreSQL database has been dramatically reduced. After a new PostgreSQL version is released, Citus packages are often updated and in sync within days.
Connecting to Google Sheets with Python
I wrote up my experience using Python to process data from a shared Google Sheets spreadsheet
MySQL vs. MariaDB: Reality Check
Choosing between MariaDB and MySQL? In this blog, we provide an overview of the key differences between MariaDB vs. MySQL and explore their unique use cases.