AWS Data Exchange
We live in a data-intensive, data-driven world! Organizations of all types collect, store, process, analyze data and use it to inform and improve their decision-making processes. The AWS Cloud is well-suited to all of these activities; it offers vast amounts of storage, access to any conceivable amount of compute…
Parallelism in PostgreSQL
Parallelism in PostgreSQL was implemented as part of multiple features which cover sequential scans, aggregates, and joins.
Jepsen: TiDB 2.1.7
In 2010, Google engineers Daniel Peng & Frank Dabek published Large-scale Incremental Processing Using Distributed Transactions and Notifications , which described Percolator: a Google-internal database for random access transactional workloads where low latencies are not required. Percolator uses a global…
Microsoft, UW demonstrate first fully automated DNA data storage
Researchers encode the word “hello” in fabricated DNA, convert it back to digital using fully automated DNA storage system.
Unreasonable Effectiveness of SQL
Read Couchbase engineering tutorials, product news, and customer stories on AI agents, Capella, vector search, mobile sync, and real-time analytics.
CVE-2019-9193: Not a Security Vulnerability
There is widespread mention in the media of a security vulnerability in PostgreSQL, registered as [CVE-2019-9193](https://nvd.nist.gov/vuln/detail/CVE-2019-9193). The PostgreSQL Security Team …
Using Python and OCaml in the same Jupyter notebook
The cover image is based on Jupiter family by NASA/JPL.
The Difference Between SQL’s JOIN .. ON Clause and the Where Clause
A question that is frequently occurring among my SQL training’s participants is: What’s the difference between putting a predicate in the JOIN .. ON clause and the WHERE clause? I can d…
Building a Large-Scale Distributed Storage System Based on Raft
Guest post by Edward Huang, Co-founder & CTO of PingCAP In recent years, building a large-scale distributed storage system has become a hot topic. Distributed consensus algorithms like Paxos and Raft…
Keeping Open Source Open – Open Distro for Elasticsearch
中文版 – At AWS, we focus on solving problems for customers. Over the years, customer usage and dependencies on open source technologies have been steadily increasing; this is why we’ve long been committed to open source, and our pace of contributions to open source projects – both our own and others’ – continues to…
Math in Data Science
Find out how much math is involved in data science and what math you need to know to get started in a data science role.
Forecasting in Python with Prophet
A guided walkthrough of how to use the Prophet python library to solve a common forecasting problem.
Building columnar compression in a row-oriented database
Read how we built a flexible, high-performance columnar compression mechanism for PostgreSQL to add scalability to our favorite database.
The Empty Promise of Data Moats
Data has long been lauded as a competitive moat for companies, and that narrative’s been further hyped with the recent wave of AI startups. Network effects have been similarly promoted as a defensible force in building software businesses. So of course, we constantly hear about the combination of the two: “data…
CockroachDB 19.2
CockroachDB 19.2 improves latency, reliability, and usability. We’re bringing the speed of distributed transactions closer to the theoretical minimum.
Useful Postgres Extension: Pg_stat_statements
Inspired by a talk in the PostgreSQL devroom at FOSDEM, a post on the usefulness of the pg_stat_statements extension to Postgres and why every Postgres developer should have it in their toolbox. With sections on getting started, and how to extract insights with pg_stat_statements.
Ice cold archive storage
Get the latest cloud storage news here from Google Cloud, with a new archive storage class and Persistent Disk updates.
PostgreSQL Count(*) Performance Improvements
count(*) is often quite slow in PostgreSQL. This article explores how to count rows faster using approximations and other tricks.
The Use of assert() in SQLite
The assert(X) macro is part of standard C , in the <assert.h> header file. SQLite adds three other assert()-like macros named NEVER(X), ALWAYS(X), and testcase(X).
Avoiding “OR” for Better Query Performance
OR in the WHERE condition of a PostgreSQL database query is usually a cause of bad query performance. How to rewrite queries without OR.
Postgres tips for the average and power user
A collection of power user tips for those working with Postgres
Amazon Launches Managed Cassandra Service
Managing databases at scale is never easy. One of the options to store, retrieve, and manage large amounts of structured data, including key-value and tabular formats, is Apache Cassandra. With Cassandra, you can use the expressive Cassandra Query Language (CQL) to build applications quickly. However, managing large…
Linux Fsync Issue for Buffered IO and Its Preliminary Fix for PostgreSQL
With the latest upgrades to PostgreSQL the fsync failure had been fixed. Avinash Vallarapu takes a look at why this issue might cause problems.
Random Forest vs. Neural Network
Choosing between Random Forest and Neural Network depends on the data type. Random Forest suits tabular data, while Neural Network excels with images, audio, and text data.