Alternatives

Products that do what (Sukhoi) Minimalist and Powerful Web Crawler in Python does

1. 1SA
   Sukhoi A highly flexible Web Crawler in Python▲5

   2020 · github.com

2. 2SA
   Sukhoi – A flexible and extensible Webcrawler in Python▲131

   2017 · github.com

3. 3CO
   Crawlab: Open-Source Web Crawler Admin Platform That Runs Any Language▲116

   2019 · github.com

4. 4AP
   A Python Spider System with Web UI▲159

   2014 · github.com

5. 5IC
   I created a tiny web crawler for Python▲5

   2024 · github.com

6. 6IW
   I wrote a tiny Python-based HN crawler with scrapy▲53

   2012 · github.com

7. 7SA
   Scraperjs – A versatile web scraper▲192

   2014 · github.com

8. 8AM
   A modular, durable web-crawler for Clojure▲29

   2016 · github.com

9. 9SE
   Search Engine and Crawler in Python▲21

   2017 · openstar.pw

10. 10AM
    A Multi-billion page web crawler in the cloud▲14

    2017 · mixnode.com

11. 11CA
    Clayoven – a minimalist website generator for math, code, and articles▲149

    2019 · github.com

12. 12AS
    Apify SDK – A scalable web crawling and scraping library for JavaScript▲78

    2018 · github.com

13. 13AH
    Apifier – hosted web crawler for developers▲101

    2015 · apifier.com

14. 14SA
    Scrapple – A framework for creating semi-automatic web extractors▲29

    2015 · github.com

15. 15AT
    A tiny web browser implementation with V8 JavaScript engine and Rust▲144

    2021 · github.com

16. 16WS
    Web scraping page analyzer▲166

    2018 · apify.com

17. 17AD
    A distributed and persistent web crawler written in Go▲5

    2017 · github.com

18. 18CF
    Checkbot for Chrome – web crawler that tests for web best practices▲83

    2018 · checkbot.io

19. 19AP
    A pure Python implemention of Apache Thrift▲64

    2014 · thriftpy.readthedocs.org

20. 20AO
    An open source web crawler for the Mwmbl non-profit search engine▲6

    2022 · github.com

21. 21PA
    PyCloud, a Python IDE in the web browser with interactive tutorials▲130

    2011 · jitouch.com

22. 22SA
    ScreenSlicer – Automatic, zero-config web scraping▲26

    2014 · github.com

23. 23AP
    A Python native engine for web development▲24

    2021 · github.com

24. 24AS
    A Simple Search Engine▲30

    2020 · kuurio.com

Ranked by how close each launch is in meaning, then by votes. Refine with a description →