Life & fun · September 4, 2023
Rapidgzip – Truly Parallel Gzip Decompression with 10 GB/s
I have posted a much earlier version of this over a year ago [0]. Since then a lot has changed. Obviously, the name has changed. This happened for the paper publication [1]. I have also optimized the speed, integrated ISA-L for special cases, limited the compression-ratio-dependent maximum memory consumption, and finally added parallelized CRC32 computation, which adds ~5% overhead no matter the number of cores used. At this point, I am leaning towards calling it production-ready although there are still many ideas for improvements. Redoing the benchmarks of the older Show HN, would look…
Rapidgzip – Truly Parallel Gzip Decompression with 10 GB/s launched on September 4, 2023 with 35 votes, #1,326 of 4,228 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 3 years on.
In plain words
Rapidgzip is a parallel gzip decompression tool that achieves decompression speeds of approximately 10 GB/s, significantly faster than traditional single-threaded alternatives. It is designed for users who need to decompress large gzip files efficiently, particularly those working with large datasets or in performance-critical environments. The tool features optimized speed through ISA-L integration, memory consumption controls, and parallelized CRC32 computation, making it suitable for production use.
written from the facts on this page · September 2026
From the sources
Gzip Decompression and Random Access for Modern Multi-Core Machines - mxmlnkn/rapidgzip
In the maker’s words, at launch
I have posted a much earlier version of this over a year ago [0]. Since then a lot has changed. Obviously, the name has changed. This happened for the paper publication [1]. I have also optimized the speed, integrated ISA-L for special cases, limited the compression-ratio-dependent maximum memory consumption, and…
Does a similar job
all alternatives →
Thread-Parallel Decompression and Random Access to Gzip Files (Pragzip)2022 · github.com · ▲15Hello HN, I'm very excited to have finished a gzip decoder that can speed up decompression using threads. On my Ryzen 3900X, I measured a 8x speedup over standard gzip, reaching 1.6 GB/s for a synthetic file with a consistent compression ratio of 1.3. A functional decompressor like this is kind of a first, that's why I am excited. Pragzip implements the two-staged decompression idea put forward with pugz, which unfortunately only works with gzipped text files not arbitrary files and has many more limitations. I think my main contribution over pugz might be a fast (~10 MB/s)…
Mini_gzip – embeddable, minimal, in-memory Gzip API2015 · github.com · ▲21Embeddable minimal in-memory GZIP decompression library for embedded systems - wkoszek/mini_gzip
10-40% faster LZMA decoder using x86 CMOVcc2021 · gist.github.com · ▲205Faster LZMA decoder for x86 CPUs (patch for XZ Utils). - faster_lzma_decoder_x86.patch
CompressImage.io2022 · compressimage.io · ▲261Reduce image size up to 90% in seconds, free & works offline
pzip- blazing fast concurrent zip archiver and extractor2023 · github.com · ▲26A blazing fast concurrent zip archiver and extractor. - ybirader/pzip
misa77 - a codec that decodes 2x faster than LZ4 (at better ratios)Jul 2026 · github.com · ▲164I've spent the last few months working on this codec. It has the following characteristics: - SOTA decompression throughput in its ratio class - Decent ratios (comparable to LZ4 at high effort levels) - Slow compression Most of the gains can be attributed to reducing branches and making decompression very friendly to out-of-order cores, by using a smart format. Results on the tarred Silesia corpus on Intel x86-64 follow: codec decode ratio encode misa77 -0 5219 MB/s 42.64% 54.5 MB/s misa77 -1 4274 MB/s 39.65% 51.2 MB/s lz4 2505 MB/s 47.59% 371 MB/s lz4hc -12…
More life & fun this month
the category →
A free city-building game in your browser. You are the mayor. You know what the city needs. Now get it past the zoning board, the neighbors, the appeals court and the next election.
Life & fun · 2d ago · permit.petercai.com
- IV
Life & fun · 15d ago · tanzaniaeducationproject.org
Turn a phone, tablet or TV into a sign. Type a message and it fills the screen: welcome signs, timers, Wi-Fi passwords and more. No app, no account, free.
Life & fun · 15d ago · bigwords.page
Play a free virtual guitar online with your keyboard or by touch. Slow songs down and see every chord, string and strum. Acoustic, classic, electric and bass.
Life & fun · 9d ago · guitoro.com
Carrier settings from iPhone, Pixel and Galaxy firmware, decoded and compared: APNs, VoLTE, 5G and Wi-Fi Calling per carrier, and what each build changed.
Life & fun · 13d ago · carrierexplode.com
Life & fun · 23d ago · space.bl2.net
Source: Show HN post ↗ · launch text quoted in part
