Dev tools · alternatives · 2026

24 alternatives to (Sukhoi) Minimalist and Powerful Web Crawler in Python

Minimalist and powerful Web Crawler. Contribute to untwisted/sukhoi development by creating an account on GitHub.

Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. (Sukhoi) Minimalist and Powerful Web Crawler in Python launched in 2017; newer entries below may have overtaken it.

1. 1
   Sukhoi – A flexible and extensible Webcrawler in Python▲131

   Minimalist and powerful Web Crawler. Contribute to untwisted/sukhoi development by creating an account on GitHub.

   2017 · github.com · its alternatives →

2. 2
   Sukhoi A highly flexible Web Crawler in Python▲5

   Minimalist and powerful Web Crawler. Contribute to untwisted/sukhoi development by creating an account on GitHub.

   2020 · github.com · its alternatives →

3. 3
   Crawly▲606

   Never write another web scraper

   2016 · crawly.diffbot.com · its alternatives →

4. 4
   Crawler.sh▲349

   Ultra-fast desktop & CLI app that finds your SEO & AEO issues and allows you to extract your content as Markdown

   Mar 2026 · crawler.sh · its alternatives →

5. 5
   A Python Spider System with Web UI▲159

   A Powerful Spider(Web Crawler) System in Python. Contribute to binux/pyspider development by creating an account on GitHub.

   2014 · github.com · its alternatives →

6. 6SE
   Search Engine and Crawler in Python▲21

   2017 · openstar.pw · its alternatives →

7. 7
   Headless Chrome Crawler▲172

   Distributed crawler powered by Headless Chrome. Contribute to yujiosaka/headless-chrome-crawler development by creating an account on GitHub.

   2018 · github.com · its alternatives →

8. 8
   Crawlab: Open-Source Web Crawler Admin Platform That Runs Any Language▲116

   Distributed web crawler admin platform for spiders management regardless of languages and frameworks. - tikazyq/crawlab

   2019 · github.com · its alternatives →

9. 9
   Crawlee – Web scraping and browser automation library for Node.js▲282

   Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…

   2022 · crawlee.dev · its alternatives →

10. 10
    HyperCrawl ▲150

    Super-fast web crawling for LLM development

    2024 · its alternatives →

11. 11
    I created a tiny web crawler for Python▲5

    A simple and easy to use web crawler for Python. Contribute to DataCrawl-AI/datacrawl development by creating an account on GitHub.

    2024 · github.com · its alternatives →

12. 12
    Scrapeless▲168

    Effortless web scraping toolkit for businesses & developers

    2025 · scrapeless.com · its alternatives →

13. 13
    Zero-Config Documentation Websites for Python▲233

    2019 · timothycrosley.github.io · its alternatives →

14. 14
    Script on Top of Python Sukhoi Web Crawler Framework to Apply for Jobs▲5

    2019 · github.com · its alternatives →

15. 15
    WebAutomation.io▲154

    The biggest marketplace of readymade no code web scrapers

    2021 · webautomation.io · its alternatives →

16. 16
    A Python native engine for web development▲24

    A Pythonic wraparound of HTML/CSS/JS. Contribute to BrainStormYourWayIn/sierra development by creating an account on GitHub.

    2021 · github.com · its alternatives →

17. 17
    Voyager – write a web crawler/scraper as a state machine in Rust▲110

    crawl and scrape web pages in rust. Contribute to mattsse/voyager development by creating an account on GitHub.

    2020 · github.com · its alternatives →

18. 18AP
    A pure Python implemention of Apache Thrift▲64

    2014 · thriftpy.readthedocs.org · its alternatives →

19. 19
    A set of handy tools to work with sequences and collections in Python▲29

    A fancy and practical functional tools. Contribute to Suor/funcy development by creating an account on GitHub.

    2013 · github.com · its alternatives →

20. 20
    A modular, durable web-crawler for Clojure▲29

    :racehorse:✈️ Pegasus is a scalable, modular, polite web-crawler for Clojure - shriphani/pegasus

    2016 · github.com · its alternatives →

21. 21
    Supacrawler▲9

    Headless browser tool for scraping anything on the internet

    2025 · its alternatives →

22. 22
    I wrote a tiny Python-based HN crawler with scrapy▲53

    A scrapy-based Hacker News crawler. Contribute to mvanveen/hncrawl development by creating an account on GitHub.

    2012 · github.com · its alternatives →

23. 23
    Python 3.5 Async Web Crawler Example▲28

    Python3.5 async crawler example with aiohttp and asyncio - mehmetkose/tangrowth

    2016 · github.com · its alternatives →

24. 24
    Diggernaut – Turn website content into data sets▲49

    Web scraping is just became easy. Extract any website content and turn it into datasets. No programming skills required.

    2016 · diggernaut.com · its alternatives →

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →