A distributed queue in a single JSON file on object storage
How to build a single global queue for distributed systems on object storage: Start with a single file on object storage, then add write batching, a stateless broker, and high-availability.
Topics /
The most popular blog posts about infrastructure & devops on Hacker News. 2,538 posts.
How to build a single global queue for distributed systems on object storage: Start with a single file on object storage, then add write batching, a stateless broker, and high-availability.
Online payment processing for internet businesses. Stripe is a suite of payment APIs that powers commerce for businesses of all sizes.
Tailscale Services is a new way to define available resources on your network and expand the granularity of your access controls to resources that may not have Tailscale installed on them.
March 15, 2023 – You can now use S3 Object Lambda with Amazon CloudFront to tailor content for end users. August 13, 2024 – Added a note clarifying that, when following the walkthrough, you should not mark the Specify Lambda function version option that was added after this post was published. When you store data in…
Learn how to run containers on AWS Lambda and leverage the scalability and cost-saving benefits of serverless computing. This article explores the ...
Like all AWS services, the Amazon S3 team is always listening to customers in order to better understand their needs. After studying a lot of feedback and doing some analysis on access patterns over time, the team saw an opportunity to provide a new storage option that would be well-suited to data that is accessed […]
My colleague Mingxue Zhao sent me a guest post designed to make sure that you are aware of an important time / clock issue. Note: This post was first published on May 18, 2015. We made some important additions and corrections on May 25, 2015. — Jeff; The International Earth Rotation and Reference Systems (IERS) […]
By Michael Behr, Software Engineer; Ian Swett, Software Engineer For four years now, Google has been using QUIC, a UDP-based encrypted tra...
Get all of the latest cloud storage news and insights from Backblaze - the leading independent cloud storage provider.
Announcing Teleport Wormhole, a new open source Kubernetes network plugin that combines the simplicity of flannel with encrypted networking from WireGuard.
Posted by Noah Fiedel, Software EngineerMachine learning powers many Google product features, from speech recognition in the Google app to Smart Re...
Our Security Infrastructure team introduces the principles we follow to build security in Monzo’s fast-moving engineering environment and how they work with other engineering teams to keep our customers and platform safe.
Connectivity is at the heart of our mission to give people the power to build community. We are committed to bringing more people online to a faster internet — and with 3.5 billion people globally …
A couple of months ago Finnair announced the launch of the new A350 aircraft, making it the first European airline to start operating the model. We are
This post is part of a two-part series, of which this is the first. In this post, we go a bit into the infrastructure that runs OpenTTD, from BaNaNaS to our main website. The second post will explain a bit about the migration we just did to get to this infrastructure.
Yes you read that correctly - a 60TB SSD. So what does that mean for cloud backup? Is a 3.6PB storage pod on the horizon? We take a look at the numbers.
Basic introduction to Kubernetes Operators and Controllers, with a tutorial on creating an Operator in Rust
Vagrant 1.4 has been released! This is a major new release of Vagrant with an incredible amount of new features, improvements, and bug fixes. Vagrant 1.4 can be downloaded on our new downloads page. First, I have to thank the new core committers of Vagrant for building many of the incredible features and improvements…
Directfs is now the default in runsc. This feature gives gVisor’s application kernel (the Sentry) secure direct access to the container filesystem, avoiding expensive round trips to the filesystem gofer. Learn more about this feature in the following blog that was originally posted on Google Open Source Blog .
Serverless, Inc. has brought Serverless Framework V.1 out of beta and also closed a seed round from Trinity Ventures.
Many AWS customers are using AWS Lambda to build clean, straightforward applications that handle image and document uploads, process log files from AWS CloudTrail, handle data streamed from Amazon Kinesis, and so forth. With the recently launched synchronous invocation capability, Lambda is fast becoming a favorite…
We take a look at the performance of our 86,529 hard drives and break down the failure rates by manufacturer and model size.
Today we’re excited to announce that we’ll be adding support for Swift packages to GitHub Package Registry. Swift packages make it easy to share your libraries and source code across your projects and with the Swift community.
7 lessons we've learned while managing 200+ open-source repositories - automation with a human touch.