1
Running Awk in parallel to process 256M records
TL;DR Awk crunches massive data; a High Performance Computing (HPC) script calls hundreds of Awk concurrently. Fast and scalable in-memory solution on a fat machine.
Ketan Maheshwari
Notes about the stuff that I do or find interesting.
- Popular posts
- 1
- Total points
- 358
- HN comments
- 101
- Rank
- #7,511 personal
Visit ketancmaheshwari.github.io → On Hacker News Jun 2020 – Jun 2020