Parallel compression

1 · Patrick Diehl · Aug. 24, 2021, 9:03 p.m.
Sometimes it can be useful to compress large archives in parallel to speedup the task. A common tool on Linux is gzip gzip data.tar to compress the data.tar archive and obtain the compressed data.tar.gz. To speedup the process there is a parallel implementation pigz available. You can download pigz and compile it using the following code snippt wget https://github.com/madler/pigz/archive/refs/tags/v2.6.tar.gz tar -xvf v2.6.tar.gz cd v.2.6/ make To compress the archive in parallel you can run ....