Getting 10TB of GitHub logs and extracting details of all users and repositories
Trickest workflow parses 15TB of GitHub Archive logs and extracts public details for every user and repository back to 2015.
Topics /
The most popular blog posts about infrastructure & devops on Hacker News. 2,538 posts.
Trickest workflow parses 15TB of GitHub Archive logs and extracts public details for every user and repository back to 2015.
Forth has been called lots of things and it was something that I figured we could easily unikernelize so I dove into it. I think it's safe to say I've never written any production Forth nor do I see myself doing so but having said that - let's begin!
Discover more about what's new at AWS with Announcing New Amazon EC2 M3 Instance Sizes and Lower Prices for Amazon S3 and Amazon EBS
Using Iceberg allows us to pick the optimal "big data" compute environment for the specific requirements we have. There's no need to limit yourself to a single solution.
Yesterday the OpenSSL Project released an update to address the CVE-2014-0160 vulnerability, nicknamed “Heartbleed.” This serious vulnerability affects a..
No single cloud fits all. Explore how we build a more flexible future with hybrid cloud.
Back in 2015 we deployed ECMP routing - Equal Cost Multi Path - within our datacenters. This technology allowed us to spread traffic heading to a single IP address across multiple physical servers.
Discover more about what's new at AWS with Elastic Load Balancing Adds Support for Host-based Routing and Increased Rules on its Application Load Balancer
Threats to your IT infrastructure (AWS accounts & credentials, AWS resources, guest operating systems, and applications) come in all shapes and sizes! The online world can be a treacherous place and we want to make sure that you have the tools, knowledge, and perspective to keep your IT infrastructure safe & sound…
Google has acquired Crusoe’s southeast Wyoming data center site after Crusoe completed site selection, approvals, and power strategy for the campus.
Google Cloud’s new Accelerator-Optimized (A2) VM family is based on the NVIDIA Ampere A100 GPU, and designed for demanding HPC and ML workloads.
Step by step guide to build highly optimized docker images for Golang web-app development and deployment
How to provision a new NixOS machine on Digital Ocean with nixos-infect and automatically connect it to your Tailscale network, then use that server to set up a fully private Minecraft world.
Today marks the start of a new era for IPv6. Building on the great success of last year’s World IPv6 Day, this year’s “World IPv6 Launch” will bring together major Internet service providers (ISPs), home networking equipment manufacturers, and web companies around the world to permanently enable IPv6 for their…
Today, we're excited to announce that we have eliminated the cluster management fee for Google Kubernetes Engine , our managed Kubernetes service.
AWS customers in a wide variety of industries use Amazon DynamoDB to store mission-critical data. Financial services, commerce, AdTech, IoT, and gaming applications (to name a few) make millions of requests per second to individual tables that contain hundreds of terabytes of data and trillions of items, and count on…
Expert insight, best practices, and advice on Secure DevOps, security for containers, Kubernetes, and cloud services. Review Sysdig blog posts today!
Nineteen distribution channels later: what it actually costs to give a terminal editor away for free on Linux, and why the next step is a static musl binary that updates itself.
New installer, Active Directory login and gaming performance enhance Ubuntu Desktop for work and play in the latest interim release of Ubuntu. […]
If you’re currently using LTO for backup or archive, you have a few options for weathering the LTO-8 shortage. Let's take a look at the options.
Amazon S3 turned 15 earlier this year, and Amazon EC2 will do the same in a couple of months. Today we are celebrating the tenth birthday of AWS Identity and Access Management (IAM). The First Decade Let’s take a walk through the last decade and revisit some of the most significant IAM launches: May 2011 […]
In order to support its growing ecosystem and community as we move toward the 3.0 release, we are making changes to Vagrant that will maintain its Ruby-based features while being ported to Go.