Alternatives

Products that do what Sukhoi A highly flexible Web Crawler in Python does

1. 1SA
   Sukhoi – A flexible and extensible Webcrawler in Python▲131

   2017 · github.com

2. 2SM
   (Sukhoi) Minimalist and Powerful Web Crawler in Python▲6

   2017 · github.com

3. 3SA
   Scraperjs – A versatile web scraper▲192

   2014 · github.com

4. 4CO
   Crawlab: Open-Source Web Crawler Admin Platform That Runs Any Language▲116

   2019 · github.com

5. 5AP
   A Python Spider System with Web UI▲159

   2014 · github.com

6. 6SE
   Search Engine and Crawler in Python▲21

   2017 · openstar.pw

7. 7AM
   A Multi-billion page web crawler in the cloud▲14

   2017 · mixnode.com

8. 8AM
   A modular, durable web-crawler for Clojure▲29

   2016 · github.com

9. 9AS
   Apify SDK – A scalable web crawling and scraping library for JavaScript▲78

   2018 · github.com

10. 10WS
    Web scraping page analyzer▲166

    2018 · apify.com

11. 11SA
    Scrapple – A framework for creating semi-automatic web extractors▲29

    2015 · github.com

12. 12IC
    I created a tiny web crawler for Python▲5

    2024 · github.com

13. 13AA
    An API for scraping recipe web pages▲208

    2017 · choppingboard.recipes

14. 14AH
    Apifier – hosted web crawler for developers▲101

    2015 · apifier.com

15. 15MP
    MechanicalSoup, Python library for automating interaction with websites▲180

    2014

16. 16IW
    I wrote a tiny Python-based HN crawler with scrapy▲53

    2012 · github.com

17. 17MA
    Makesite – A static site generator in 125 lines of Python▲146

    2018 · github.com

18. 18TA
    Transistor, a Python web scraping framework for intelligent use cases▲12

    2019 · github.com

19. 19AD
    A distributed and persistent web crawler written in Go▲5

    2017 · github.com

20. 20CF
    Checkbot for Chrome – web crawler that tests for web best practices▲83

    2018 · checkbot.io

21. 21AO
    An open source web crawler for the Mwmbl non-profit search engine▲6

    2022 · github.com

22. 22HC
    Highly cost-efficient search engine in Rust▲61

    2021 · github.com

23. 23AP
    A Python native engine for web development▲24

    2021 · github.com

24. 24AW
    A web crawler that builds word frequency lists for websites▲9

    2018 · github.com

Ranked by how close each launch is in meaning, then by votes. Refine with a description →