Alternatives
Products that do what Rust BPE tokenizer for Qwen models that's 12x faster than HuggingFace does
- 1CA
2018 · github.com
- 2IA
2014 · github.com
- 3PF
2017 · github.com
- 4HF
2020 · github.com
- 5HS
2021 · github.com
- 6AT
2017 · github.com
- 7

- 8FA
2021 · github.com
- 9AW
2018 · github.com
- 10HC
2021 · github.com
- 11IB
2021 · kdab.com
- 12PJ
2018 · github.com
- 13PA
2016 · gitlab.com
- 14ML
2016 · github.com
- 15T5
2021 · tensorbase.io
- 16SM
2020 · github.com
- 17JA
2020 · crates.io
- 18HR
2018 · github.com
- 19AS
2018 · lukaslueg.github.io
- 20AE
2025 · github.com
- 21AF
2016 · github.com
- 22PA
2017 · github.com
- 23RB
Happy to release FastPlaid, which aim to ease and accelerate ColBERT and ColPali retrieval
2025 · github.com
- 24RA
2015 · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →