Compressed directories on Linux
Compressed directories on Linux launched on May 7, 2017 with 70 votes, #651 of 3,229 launches that month and more than 90% of that year's launches. The site was still online in September 2026, 9 years on.
In plain words
This is a technical guide for Linux users managing large, repetitive files such as test vectors or trace data. It explains how to use BTRFS filesystem with loopback devices to create compressed directories, achieving transparent compression on a single directory without modifying the entire system. The approach uses LZO compression to reduce storage requirements and improve read-write performance for data-heavy workloads, making it practical for datasets approaching terabyte sizes.
written from the facts on this page · September 2026
From the sources
I had a situation with very large, compressible files. These files are huge, but mostly repeated data -- they are test vectors for a piece of hardware. As the traces have grown towards 1TB, reading and writing has got painfully slow. What I need was lightweight transparent compression that works on one directory. Here is one answer that seems to work: use the 'loopback' device to create a small BTRFS filesystem. BTRFS lzo optimization works very well. The data fit in a fraction of the storage, and reading and writing are much faster. Create a backing store for the volume. Here it's sized at 50 GB: That's it. The filesystem is ready to fill up with redundantfrom excamera.com
Does a similar job
all alternatives →
I missed the moving blocks, so I built a real Linux disk defragmenterAug 2026 · github.com · ▲97Linux filesystem defragger written in Rust and Qt Quick/Kirigami - gbin/defragger
- WSWe scaled Git to support 1 TB repos2022 · xethub.com · ▲279
I’ve been in the MLOps space for ~10 years, and data is still the hardest unsolved open problem. Code is versioned using Git, data is stored somewhere else, and context often lives in a 3rd location like Slack or GDocs. This is why we built XetHub, a platform that enables teams to treat data like code, using Git. Unlike Git LFS, we don’t just store the files. We use content-defined chunking and Merkle Trees to dedupe against everything in history. This allows small changes in large files to be stored compactly. Read more here:…
I made an ls alternative for my personal use2024 · github.com · ▲197blazing fast `ls` replacement with superpowers. Contribute to chaqchase/lla development by creating an account on GitHub.
On-disk B+ tree for Python 32018 · github.com · ▲159An on-disk B+tree for Python 3. Contribute to NicolasLM/bplustree development by creating an account on GitHub.
- WFWget-finder2015 · javier.io · ▲130
Since some days ago I’ve been playing with bifrost-build, a github repository with recipes for building static linux binaries. The recipes are no different from other linux distributions where an…
More life & fun this month
the category →
A free city-building game in your browser. You are the mayor. You know what the city needs. Now get it past the zoning board, the neighbors, the appeals court and the next election.
Life & fun · 2d ago · permit.petercai.com
- IV
Life & fun · 14d ago · tanzaniaeducationproject.org
Turn a phone, tablet or TV into a sign. Type a message and it fills the screen: welcome signs, timers, Wi-Fi passwords and more. No app, no account, free.
Life & fun · 15d ago · bigwords.page
Play a free virtual guitar online with your keyboard or by touch. Slow songs down and see every chord, string and strum. Acoustic, classic, electric and bass.
Life & fun · 9d ago · guitoro.com
Carrier settings from iPhone, Pixel and Galaxy firmware, decoded and compared: APNs, VoLTE, 5G and Wi-Fi Calling per carrier, and what each build changed.
Life & fun · 13d ago · carrierexplode.com
Life & fun · 23d ago · space.bl2.net
Source: Show HN post ↗
Launched alongside, May 2017
the whole month →
Things 3.0▲757Complete revamp of the original, award-winning task manager
Work · 2017 · culturedcode.com