Bede Constantinides personal blog

Removing newlines in FASTA file increases ZSTD compression ratio by 10x

First released with Zstandard 1.3.2 in 2017, the --long range match finder increases the compressor’s search window to at least 128MiB, improving deduplication inside large files. This optional feature had substantial performance overheads at launch, but various optimisations have since brought its performance within…
Points
279
HN comments
113
Submissions
1
Cited by
0 commenters

Databases & DataSystems & Performance2025

On Hacker News

SubmittedTitle on HNPointsComments
Sep 12, 2025Removing newlines in FASTA file increases ZSTD compression ratio by 10x by bede279113

Related posts from the same era