PZip.net Compression
The most powerful compression on Earth
What it does
Silicon Valley was one of my favorite shows and I used to think Pied Piper and their compression algorithm was cool but unrealistic. It turns out I was wrong. I just invented the REAL PIED PIPER and launched PZip.net It turns out the solution was USA + Russia -> Shannon + Kolmogorov. These are the two greatest minds in math history but because of the cold war, they didn't really interact. If they did, they would have worked together and discovered PZip. PZip is FREE for public use!
Does the same job
all alternatives →
- OAOverfitted a 900KB Transformer to Compress a 100MB CSV into 7MBJun 2026 · ▲112
I built an experiment that uses an overfitted transformer and arithmetic coding to compress individual files. Instead of training the model to generalize, I train a 900KB transformer to memorize a single file and predict the next byte. Those predictions are fed into an arithmetic coder to produce the compressed output. On a 100MB NYC taxi CSV, it compresses to about 7MB (~0.5 bits/byte). On a 100MB slice of enwik9, it compresses to about 21MB (~1.68 bits/byte). It's pretty slow right now (roughly 20–30 minutes of training and 45 minutes each for compression and decompression on my…
- CMCompressX, my FFmpeg wrapper for macOS2024 · compressx.app · ▲170
Hey HN, just wanted to share my success story with CompressX, my FFmpeg wrapper for macOS. For those who may not be familiar, FFmpeg is a powerful tool for converting, streaming, and recording audio and video content. I started CompressX as a weekend project to serve my 9-5 jobs, primarily to compress demo videos for uploading to GitLab and sharing with my colleagues. It took me 2 weeks to make the first working version. I shared the demo on Twitter and the reaction was extraordinary. People loved it, they said that I was bringing the Pied Piper to life. Four months later, I hit the $9,000…
- RTRapidgzip – Truly Parallel Gzip Decompression with 10 GB/s2023 · github.com · ▲35
I have posted a much earlier version of this over a year ago [0]. Since then a lot has changed. Obviously, the name has changed. This happened for the paper publication [1]. I have also optimized the speed, integrated ISA-L for special cases, limited the compression-ratio-dependent maximum memory consumption, and finally added parallelized CRC32 computation, which adds ~5% overhead no matter the number of cores used. At this point, I am leaning towards calling it production-ready although there are still many ideas for improvements. Redoing the benchmarks of the older Show HN, would look…
- PBpzip- blazing fast concurrent zip archiver and extractor2023 · github.com · ▲26
More dev tools this month
the category →
The first open-source price index for GPU compute
Dev tools · 10d ago · getcomputable.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 2d ago · opentrailpaper.com
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
