The latest blog posts to take off on Hacker News. 2,337 posts.
As the volume and complexity of your data processing pipelines increase, you can simplify the overall process by decomposing it into a series of smaller tasks and coordinate the execution of these tasks as part of a workflow. To do so, many developers and data engineers use Apache Airflow, a platform created by the…
This is a briefing on SQLite intended for Linux kernel hackers, and especially those working on Linux filesystems.
Many developers believe S3 is the "end of file system history". It is impossible to build a file/object storage system on AWS that can compete with S3...
Fully managed Cloud SQL cloud database service now supports PostgreSQL 13.
InfluxData Founder & CTO Paul Dix lays out a vision for the future of InfluxDB and introduces a new project that will form its basis: InfluxDB IOx.
Why it’s important to improve Postgres connection scalability, plus an analysis on the limits of connection scalability today.
Mendoza is a new, super efficient format for expressing differences between JSON documents.
Fully managed PostgreSQL from the creators of TimescaleDB. 99.9% uptime SLA, 10,000+ IOPS, columnar compression up to 95%, and built-in search. Try it free.
In this first post of Tweag’s four-part series on Markov chain Monte Carlo sampling algorithms, you will learn about why and when to use them and the theoretical underpinnings of this powerful class of sampling methods. We discuss the famous Metropolis-Hastings algorithm and give an intuition on the choice of its free…
An experiment analyzing the NYC taxi dataset through the eyes of an options trader.
Improving connection scalability in Postgres 14. From the neat to the gritty: snapshot scalability edition.
I recently wrote a post to announce the availability of M6g, R6g and C6g families of instances on Amazon Elastic Compute Cloud (Amazon EC2). These instances offer better cost-performance ratio than their x86 counterparts. They are based on AWS-designed AWS Graviton2 processors, utilizing 64-bit Arm Neoverse N1 cores…
Is there any command to see the history of a file beyond renames, similar to git log --follow <file> ?
A look at the performance of 150,757 hard drives in the Backblaze data centers.
According to Andreessen Horowitz, this number is one of the top 16 metrics to measure a SaaS startup by. Well, sorry Andreessen, and sorry Horowitz, but this just isn't right.
To help data teams stay on top of the changes happening in the industry, this article reviews an updated set of data infrastructure architectures.
TiDB is the distributed SQL database built for AI agents. Vectors, transactions, and analytics in one engine with ACID guarantees and elastic scale.
Percona has developed a new pg_stat_monitor plugin for PostgreSQL which captures all the details in order to provide deep query performance insights.
This is a major milestone. After almost 2 years of development, version 2.0 of VisiData is finally released. It's got several major improvements, a bunch of new loaders, and tons of new features and quality of life improvements. And, most importantly, an API specification for plugins.
How we leveraged a textbook data structure in our core platform and achieved a 15x speed up for a key data processing step.
A short story about SQL's better rival: Michael Stonebraker's storied query language, QUEL.
The feature store is a data warehouse of features for machine learning (ML)....
An overview of some of the reasons Snowflake is trading at 150x its revenue.
The PostgreSQL Global Development Group today announced the release of [PostgreSQL 13](https://www.postgresql.org/docs/13/release-13.html), the latest version of the world’s [most advanced …
Introduction to managing DB shcema changes with Liquibase
Learn about smaller indexes with B-Tree Deduplication, Extended Statistics Improvements, Parallel VACUUM, improved WAL Usage Stats in Postgres 13, and more.
Today we’re introducing Pebble, a RocksDB-inspired and RocksDB compatible key-value store written in Go that brings greater stability to CockroachDB.
