1231
OpenZFS – dRAID, Finally
Learn about dRAID in OpenZFS 2.1. Explore its data protection capabilities, distributed hot spares, faster resilvering, and enhanced performance in this article.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 2,337 posts.
1232
Eventual Consistency isn’t for Streaming
Understand why eventual consistency isn't suitable for streaming systems & the systematic errors it can cause with Materialize's insights.
1233
About ZFS Performance
You likely know I like the ZFS filesystem a lot. ZFS stores the files in B-trees in a similar fashion as InnoDB stores data.
1234
Using Python and OCaml in the same Jupyter notebook
The cover image is based on Jupiter family by NASA/JPL.
1235
We sped up time series by 20-30x
This is a follow up post that dives into how we managed to achieve such huge performance gains for time series (among other things), and why it was so hard in the first place.
1236
Pgsql: Create an infrastructure for parallel computation in PostgreSQL
Create an infrastructure for parallel computation in PostgreSQL. This does four basic things. First, it provides convenience routines to coordinate …
1237
Quicker serverless Postgres connections
Neon’s serverless driver redirects the PostgreSQL TCP wire protocol over WebSockets. This makes ordinary, fully-functional PostgreSQL connections accessible from new environments — including serverless platforms like Cloudflare Workers and Vercel Edge Functions. A key feature of these environments is that state is not…
1238
Amazon S3 Transfer Acceleration
Several AWS teams are focused on simplifying and accelerating the process of moving on-premises data to the cloud. We started out with the very basic PUT operation and multipart upload in the early days. Along the way we gave you the ability to send us a disk, and made that process even easier by launching […]
1239
RethinkDB 1.6 is out: regex matching, new array operations, random sampling
This release includes regex string matching, fourteen new array operations, support for random sampling, error handling improvements, support for authentication keys, and over 65 bug fixes, features, and enhancements.
1240
Deploying PostgreSQL Clusters Using StatefulSets
Editor’s note: Today’s guest post is by Jeff McCormick, a developer at Crunchy Data, showing how to build a PostgreSQL cluster using the new Kubernetes StatefulSet feature. In an earlier post, I described how to deploy a PostgreSQL cluster using Helm, a Kubernetes package manager. The following example provides the…
1241
The Unbundling of Airflow
Star us on GitHub In each subdomain of software, we have seen the same story over and over again. Products start small, in time, add adjacent verticals and functionality to their offerings and end up becoming a platform. Once these platforms become big enough, people start to figure out how
1242
WordPress to support SQLite back end
A few months ago, a proposal was published to make WordPress officially support SQLite. After the proposal received a lot of positive feedback from the community, we started working on an implement…
1243
Postgres as a Graph Database: (Ab)Using PgRouting
Learn how to use pgRouting as a lightweight graph database solution in Postgres.
1244
1245
How we built ngrok's data platform
At ngrok, we manage a ~100TiB, 500+ table data lake, managed by a very small team. Here's a look at how we built it and what unique challenges we solved.
1246
Postgres performance analysis resulted in a 10x improvement in CPU use
Heap is the only digital insights platform that shows everything users do on your site, revealing the "unknown unknowns" that stay invisible with other tools. Learn about how we improved our performance and saved millions!
1247
1248
The Difference Between SQL’s JOIN .. ON Clause and the Where Clause
A question that is frequently occurring among my SQL training’s participants is: What’s the difference between putting a predicate in the JOIN .. ON clause and the WHERE clause? I can d…
1249
ElephantSQL Is Shutting Down
The ElephantSQL team announces that ElephantSQL will discontinue its services.
1250
Laion-5B: A new era of open large-scale multi-modal datasets
We present a dataset of 5,85 billion CLIP-filtered image-text pairs, 14x bigger than LAION-400M, previously the biggest openly accessible image-text dataset…
1251
S3 Express Is All You Need
The future of modern data infrastructure is object storage.
1252
1253
1254
Apache Kafka 0.9 is released
Major milestone release Apache Kafka 4.0 removes ZooKeeper entirely, provides early access to Queues for Kafka, and enables faster rebalances, in addition to many other new KIPs.
1255
1256
Backblaze Hard Drive Stats for 2017
Since 2013, Backblaze has been showcasing daily statistics from our hard drives. Find out how our drives have been doing throughout 2017 with this blog post.
1257
Building a Large-Scale Distributed Storage System Based on Raft
Guest post by Edward Huang, Co-founder & CTO of PingCAP In recent years, building a large-scale distributed storage system has become a hot topic. Distributed consensus algorithms like Paxos and Raft…
1258
Google-Landmarks: A New Dataset and Challenge for Landmark Recognition
Posted by André Araujo and Tobias Weyand, Software Engineers, Google ResearchImage classification technology has shown remarkable improvement over ...
1259
1260
Releasing rainbow tables to accelerate Net-NTLMv1 protocol deprecation
Mandiant aims to lower the barrier for security professionals to demonstrate the insecurity of Net-NTLMv1.