Alternatives

Products that do what Crawlab: Open-Source Web Crawler Admin Platform That Runs Any Language does

1. 1AH
   Apifier – hosted web crawler for developers▲101

   2015 · apifier.com

2. 2
   Crawlee▲229

   Build reliable web scrapers and robots, fast!

   2022

3. 3GA
   Gutenberg – A static site engine as a single executable▲241

   2017 · getgutenberg.io

4. 4SA
   Sitebulb, a website crawler and auditor for SEOs▲120

   2017 · sitebulb.com

5. 5AM
   A modular, durable web-crawler for Clojure▲29

   2016 · github.com

6. 6AO
   An open source web crawler for the Mwmbl non-profit search engine▲6

   2022 · github.com

7. 7CF
   Checkbot for Chrome – web crawler that tests for web best practices▲83

   2018 · checkbot.io

8. 8AM
   A Multi-billion page web crawler in the cloud▲14

   2017 · mixnode.com

9. 9VW
   Voyager – write a web crawler/scraper as a state machine in Rust▲110

   2020 · github.com

10. 10AD
    A distributed and persistent web crawler written in Go▲5

    2017 · github.com

11. 11AR
    A remote browser product, open-sourced▲253

    2019 · github.com

12. 12OS
    Open-source search engine with 2bn-page index▲229

    2016 · deusu.org

13. 13SM
    (Sukhoi) Minimalist and Powerful Web Crawler in Python▲6

    2017 · github.com

14. 14AE
    An Easy Programming Language That Runs in the Browser▲138

    2018 · kabas.online

15. 15AS
    Apify SDK – A scalable web crawling and scraping library for JavaScript▲78

    2018 · github.com

16. 16SA
    Sukhoi A highly flexible Web Crawler in Python▲5

    2020 · github.com

17. 17SA
    Scrapple – A framework for creating semi-automatic web extractors▲29

    2015 · github.com

18. 18HC
    Highly cost-efficient search engine in Rust▲61

    2021 · github.com

19. 19AA
    ABCWeb – A Go Web Framework▲50

    2017 · github.com

20. 20IW
    I wrote a tiny Python-based HN crawler with scrapy▲53

    2012 · github.com

21. 21IC
    I created a tiny web crawler for Python▲5

    2024 · github.com

22. 22AW
    A web app authorization crawler and scanner using Puppeteer▲5

    2019 · github.com

23. 23AE
    An Easy Programming Language That Runs in the Browser via WebAssembly▲32

    2021 · easylang.online

24. 24AW
    A web crawler that builds word frequency lists for websites▲9

    2018 · github.com

Ranked by how close each launch is in meaning, then by votes. Refine with a description →