Alternatives

Products that do what An open source web crawler for the Mwmbl non-profit search engine does

1. 1OS
   Open-source search engine with 2bn-page index▲229

   2016 · deusu.org

2. 2CO
   Crawlab: Open-Source Web Crawler Admin Platform That Runs Any Language▲116

   2019 · github.com

3. 3AE
   An experimental, people-powered search engine▲215

   2021 · ninfex.com

4. 4AM
   A Multi-billion page web crawler in the cloud▲14

   2017 · mixnode.com

5. 5AH
   Apifier – hosted web crawler for developers▲101

   2015 · apifier.com

6. 6TL
   Torrentinim – low memory-footprint, API-only torrent search engine▲117

   2021 · github.com

7. 7SA
   Sitebulb, a website crawler and auditor for SEOs▲120

   2017 · sitebulb.com

8. 8SA
   Stork: A customizable, WASM-powered full-text search plugin for the web▲137

   2020 · stork-search.net

9. 9AO
   An open distributed search engine for science▲98

   2014 · juretriglav.si

10. 10AM
    A modular, durable web-crawler for Clojure▲29

    2016 · github.com

11. 11HC
    Highly cost-efficient search engine in Rust▲61

    2021 · github.com

12. 12CF
    Checkbot for Chrome – web crawler that tests for web best practices▲83

    2018 · checkbot.io

13. 13AS
    A search widget for static web sites▲88

    2017 · webtigerteam.com

14. 14AE
    An experimental code search engine▲88

    2018 · codegrep.com

15. 15SM
    (Sukhoi) Minimalist and Powerful Web Crawler in Python▲6

    2017 · github.com

16. 16AD
    A distributed and persistent web crawler written in Go▲5

    2017 · github.com

17. 17AS
    A Simple Search Engine▲30

    2020 · kuurio.com

18. 18AW
    A web crawler that builds word frequency lists for websites▲9

    2018 · github.com

19. 19PD
    Presearch: Decentralized Search Engine▲10

    2021 · presearch.org

20. 20LT
    Lightweight Torrent Search Engine▲13

    2014 · nexxus.io

21. 21AB
    a blog search engine▲27

    2013 · sotosearch.com

22. 22WA
    Wiby – A Minimalist’s Search Engine▲59

    2020 · wiby.org

23. 23SE
    Search Engine and Crawler in Python▲21

    2017 · openstar.pw

24. 24SA
    Sukhoi A highly flexible Web Crawler in Python▲5

    2020 · github.com

Ranked by how close each launch is in meaning, then by votes. Refine with a description →