Topics /
Infrastructure & DevOps
The most popular blog posts about infrastructure & devops on Hacker News. 4,375 posts.
Amazon S3 Transfer Acceleration
Several AWS teams are focused on simplifying and accelerating the process of moving on-premises data to the cloud. We started out with the very basic PUT operation and multipart upload in the early days. Along the way we gave you the ability to send us a disk, and made that process even easier by launching […]
How to Automatically Backup a Linux VPS to a Separate Cloud Storage Service
A walkthrough for backing up a Linux server to an external storage provider like Amazon S3 automatically.
Fly’s Prometheus Metrics
Documentation and guides from the team at Fly.io.
Manage Kubernetes Clusters on AWS Using Kops
Any containerized application typically consists of multiple containers. There are containers for the application itself, a database, possibly a web server, and so on. During development, it’s normal to build and test this multi-container application on a single host. This approach works fine during early dev and test…
Deploying PostgreSQL Clusters Using StatefulSets
Editor’s note: Today’s guest post is by Jeff McCormick, a developer at Crunchy Data, showing how to build a PostgreSQL cluster using the new Kubernetes StatefulSet feature. In an earlier post, I described how to deploy a PostgreSQL cluster using Helm, a Kubernetes package manager. The following example provides the…
The Unbundling of Airflow
Star us on GitHub In each subdomain of software, we have seen the same story over and over again. Products start small, in time, add adjacent verticals and functionality to their offerings and end up becoming a platform. Once these platforms become big enough, people start to figure out how
Push Notifications for Decentralized Services
How mobile push notifications currently bring centralization to decentralized services, and how we can avoid it, even for mainstream configurations. Published the 31/01/2025 This post will focus on Android. We all know decentralized applications: emails, Mastodon (and the Fediverse), Nextcloud and other clouds, Git…
Gremlin Free – Run chaos experiments to prevent outages
Get immediate access to Gremlin
Using Free SSL/TLS Certificates from Let’s Encrypt for Nginx
Deliver modern applications with NGINX. Explore high-performance load balancing, API gateways, and web server solutions trusted by top global enterprises.
Heartbeats in Distributed Systems
In distributed systems, one of the fundamental challenges is knowing whether a node or service is alive and functioning properly. Unlike monolithic applications, where everything runs in a single process, distributed systems span multiple machines, networks, and data centers. This becomes even glaring when the nodes…
Phases of Netflix’s real-time data infrastructure
The blog post will share the four phases of Real-time Data Infrastructure’s iterative journey in Netflix (2015-2021). For each phase, we will go over the evolving business motivations, the team’s unique challenges, the strategy bets, and the use case patterns we discovered along the way.
How we built ngrok's data platform
At ngrok, we manage a ~100TiB, 500+ table data lake, managed by a very small team. Here's a look at how we built it and what unique challenges we solved.
A Look inside Google’s Data Center Networks
Google has long been a pioneer in distributed computing and data processing, from Google File System to MapReduce to Bigtable and to Bor...
Quick notes about the bash bug, its impact, and the fixes so far
We spent a good chunk of the day investigating the now-famous bash bug (CVE-2014-6271), so I had no time to make too many jokes about it on...
Making my first embedded Linux system
End-to-end documentation of a journey from no PCB experience to fabricating my own Linux-ready system that can boot the latest mainline kernel. This article is the recommended reading for someone building their first embedded Linux board. F1C100s SoC is used for this sample board.
Is CBL-Mariner going to become Microsoft Linux?
Microsoft is increasingly standardizing on its in-house CBL-Mariner Linux distribution. Is this Microsoft Linux?
Migrating to CockroachDB
CockroachDB is a newSQL database, behaving much like a traditional database while providing consistent HA and scalability out of the box.
S3 Express Is All You Need
The future of modern data infrastructure is object storage.
Running NanoClaw in a Docker Shell Sandbox
Learn how to run NanoClaw, a Claude-powered WhatsApp assistant, inside a Docker Sandboxes shell sandbox for stronger isolation and proxy-managed API keys.
Fastmail 30 June outage post-mortem
A partial network outage occurred at Fastmail on June 30th, 2023. Most did not notice, but it was severe for the directly affected 3-5% of our customers.
Guix: Unifying provisioning, deployment, and management in the age of containers
This talk will reflect on what GNU Guix has to offer to users and how it compares to other approaches—from CONDA and pip to Flatpak and Docker. Guix is not only a transactional package manager and declarative GNU/Linux distribution: it’s also an environment manager, a container provisioning tool, and more. We will…