Efficient GraphQL Queries in Ruby on Rails and Postgres
We discuss what N+1 queries are, how they are easily produced in GraphQL, and how to solve them using the graphql-batch gem along with a few custom batch loaders.
Shenandoah GC in production: experience report
Update: I've made several edits to the post since Aleksey Shipilëv was kind enough to suggest many corrections and improvements.If you closely follow JVM development scene, you've probably noticed ...
AWS Data Exchange
We live in a data-intensive, data-driven world! Organizations of all types collect, store, process, analyze data and use it to inform and improve their decision-making processes. The AWS Cloud is well-suited to all of these activities; it offers vast amounts of storage, access to any conceivable amount of compute…
Parallelism in PostgreSQL
Parallelism in PostgreSQL was implemented as part of multiple features which cover sequential scans, aggregates, and joins.
Datamining Bandersnatch
You may have heard about Bandersnatch , an interactive film released on Netflix as part of the Black Mirror series. I’ve heard about it when it was released, but didn’t get around to watch it until recently, and I was surprised at how deep and thorough the implementation is. The film consists of:
Jepsen: TiDB 2.1.7
In 2010, Google engineers Daniel Peng & Frank Dabek published Large-scale Incremental Processing Using Distributed Transactions and Notifications , which described Percolator: a Google-internal database for random access transactional workloads where low latencies are not required. Percolator uses a global…
Microsoft, UW demonstrate first fully automated DNA data storage
Researchers encode the word “hello” in fabricated DNA, convert it back to digital using fully automated DNA storage system.
Book Review: Designing Data-Intensive Applications
What a great book Designing Data-Intensive Applications is! It covers databases and distributed systems in clear language, great detail and without any fluff. I particularly like that the author Ma…
Unreasonable Effectiveness of SQL
Read Couchbase engineering tutorials, product news, and customer stories on AI agents, Capella, vector search, mobile sync, and real-time analytics.
CVE-2019-9193: Not a Security Vulnerability
There is widespread mention in the media of a security vulnerability in PostgreSQL, registered as [CVE-2019-9193](https://nvd.nist.gov/vuln/detail/CVE-2019-9193). The PostgreSQL Security Team …
Using Python and OCaml in the same Jupyter notebook
The cover image is based on Jupiter family by NASA/JPL.
The Difference Between SQL’s JOIN .. ON Clause and the Where Clause
A question that is frequently occurring among my SQL training’s participants is: What’s the difference between putting a predicate in the JOIN .. ON clause and the WHERE clause? I can d…
Building a Large-Scale Distributed Storage System Based on Raft
Guest post by Edward Huang, Co-founder & CTO of PingCAP In recent years, building a large-scale distributed storage system has become a hot topic. Distributed consensus algorithms like Paxos and Raft…
Keeping Open Source Open – Open Distro for Elasticsearch
中文版 – At AWS, we focus on solving problems for customers. Over the years, customer usage and dependencies on open source technologies have been steadily increasing; this is why we’ve long been committed to open source, and our pace of contributions to open source projects – both our own and others’ – continues to…
FastSpark: A New Fast Native Implementation of Spark from Scratch
TLDR: Here is the code to explore.
Math in Data Science
Find out how much math is involved in data science and what math you need to know to get started in a data science role.
Data Still Dominates
I’m a huge proponent of designing your code around the data, rather than the other way around, and I think it’s one of the reasons git has been fairly successful… I will, in fact, claim that the difference between a bad programmer and a good one is whether he considers his code or his data structures more important…
Forecasting in Python with Prophet
A guided walkthrough of how to use the Prophet python library to solve a common forecasting problem.
PostgreSQL 11 Reestablishes Window Functions Leadership
PostgreSQL 11 offers the best OVER clause support among its competitors, true procedures, and improvements in FETCH FIRST and XML.
Databases always have a schema (2018)
You're probably reading this page because you've attempted to access some part of my blog (Wandering Thoughts) or CSpace , the wiki thing it's part of. Unfortunately you're using a browser version that my anti-crawler precautions consider suspicious, most often because it's too old (most often this applies to versions…
Building columnar compression in a row-oriented database
Read how we built a flexible, high-performance columnar compression mechanism for PostgreSQL to add scalability to our favorite database.