nowfound

Dev tools · January 2, 2021

Using SIMD to decode and encode gigabytes of varints per second in Rust

Decoding and encoding gigabytes of LEB128 variable-length integers per second in Rust with SIMD - as-com/varint-simd

Using SIMD to decode and encode gigabytes of varints per second in Rust launched on January 2, 2021 with 6 votes, #1,262 of 3,157 launches that month and more than 50% of that year's launches. The site was still online in September 2026, 5 years on.

Visit github.com ↗Alternatives

Does a similar job

all alternatives →
  • SIMD Viterbi Decoder in RustAug 2026 · github.com · ▲64

    I wrote libcorrect in C in 2016 and wanted to revisit it in Rust. Instead of doing just a direct conversion, I went down the rabbit hole of making Rust's std::simd work for me. I ended up with a templated, generic Viterbi decoder for convolutional codes that dispatches the decode at runtime depending on which instruction sets are available. For small rates and orders, the entire decode lives in registers. Larger codes work through memory but take advantage of some acceleration structures. I also spent some time building a tool to find optimal (max d_free) conv codes for a given rate and…

  • High-speed UTF-8 validation in Rust2021 · github.com · ▲127

    SIMD-accelerated UTF-8 validation for Rust. Contribute to rusticstuff/simdutf8 development by creating an account on GitHub.

  • A SIMD-accelerated noise library in Rust2018 · github.com · ▲73

    SIMD noise library for Rust. Contribute to verpeteren/rust-simd-noise development by creating an account on GitHub.

  • AF
    Apache Fory Rust – 10-20x faster serialization than JSON/ProtobufOct 2025 · fory.apache.org · ▲67

    Serialization framework with some interesting numbers: 10-20x faster on nested objects than json/protobuf. Technical approach: compile-time codegen (no reflection), compact binary protocol with meta-packing, little-endian layout optimized for modern CPUs. Unique features that other fast serializers don't have: - Cross-language without IDL files (Rust ↔ Python/Java/Go) - Trait object serialization (Box) - Automatic circular reference handling - Schema evolution without coordination Happy to discuss design trade-offs. Benchmarks:…

  • TurboRLE – Turbo Run Length Encoding using SIMD2015 · github.com · ▲23

    TurboRLE-Fastest Run Length Encoding. Contribute to powturbo/Turbo-Run-Length-Encoding development by creating an account on GitHub.

  • DivANS – Rust simd compression algorithm demo in WASM in the browser2018 · dropbox.github.io · ▲36

More dev tools this month

the category →
  • /dev/null▲487

    a social network for devs

    Dev tools · 3d ago · dev-null.sh

  • Whiteboard (YC W26) – an open-source IDE for thoughtful software design▲423

    open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

    Dev tools · 28d ago · github.com

  • Reladraw – A diagram language where you decide where to place things▲411

    Contribute to reladraw/reladraw development by creating an account on GitHub.

    Dev tools · 26d ago · github.com

  • OpenBot▲362

    Grok Bot alternative: free, local, open-source, multiplayer

    Dev tools · 23d ago · openbot.run

  • Talanoa▲346

    Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

    Dev tools · 21d ago · talanoa.email

  • CoreSpeed▲332

    One MCP for everything your agents need: apps, memory, tools

    Dev tools · 28d ago · corespeed.io

Source: Show HN post ↗

Launched alongside, January 2021

the whole month →