Ketan Maheshwari personal blog
Running Awk in parallel to process 256M records
TL;DR Awk crunches massive data; a High Performance Computing (HPC) script calls hundreds of Awk concurrently. Fast and scalable in-memory solution on a fat machine.
- Points
- 358
- HN comments
- 101
- Submissions
- 1
- Cited by
- 0 commenters
Databases & DataSoftware Engineering2020
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Jun 2, 2020 | Running Awk in parallel to process 256M records by ketanmaheshwari | 358 | 101 |
