Alternatives

Products that do what API for crawling and filtering content does

1. 1AH
   Apifier – hosted web crawler for developers▲101

   2015 · apifier.com

2. 2SE
   Search Engine and Crawler in Python▲21

   2017 · openstar.pw

3. 3AS
   Apify SDK – A scalable web crawling and scraping library for JavaScript▲78

   2018 · github.com

4. 4AW
   Automatic web page content extractor for Node.js and the command line▲94

   2014 · github.com

5. 5CO
   Crawlab: Open-Source Web Crawler Admin Platform That Runs Any Language▲116

   2019 · github.com

6. 6SA
   Scraperjs – A versatile web scraper▲192

   2014 · github.com

7. 7AT
   A Twitter crawler for app ideas▲272

   2021 · iwishtherewas.app

8. 8AA
   An API for scraping recipe web pages▲208

   2017 · choppingboard.recipes

9. 9AS
   A search widget for static web sites▲88

   2017 · webtigerteam.com

10. 10WS
    Web scraping page analyzer▲166

    2018 · apify.com

11. 11SM
    (Sukhoi) Minimalist and Powerful Web Crawler in Python▲6

    2017 · github.com

12. 12CF
    Checkbot for Chrome – web crawler that tests for web best practices▲83

    2018 · checkbot.io

13. 13IW
    I wrote a tiny Python-based HN crawler with scrapy▲53

    2012 · github.com

14. 14US
    Universal scraper for Websites and APIs▲7

    2023 · github.com

15. 15SA
    Sukhoi A highly flexible Web Crawler in Python▲5

    2020 · github.com

16. 16AM
    A Multi-billion page web crawler in the cloud▲14

    2017 · mixnode.com

17. 17SA
    Scrapple – A framework for creating semi-automatic web extractors▲29

    2015 · github.com

18. 18IC
    I created a tiny web crawler for Python▲5

    2024 · github.com

19. 19AG
    Alternative Google Web Search API▲21

    2020 · rapidapi.com

20. 20DT
    Diggernaut – Turn website content into data sets▲49

    2016 · diggernaut.com

21. 21AA
    an API to extract text from a PDF▲51

    2013 · stamplin.com

22. 22AB
    A Browse-able RESTish API▲19

    2011 · developers.snapbill.com

23. 23AM
    A modular, durable web-crawler for Clojure▲29

    2016 · github.com

24. 24AO
    An open source web crawler for the Mwmbl non-profit search engine▲6

    2022 · github.com

Ranked by how close each launch is in meaning, then by votes. Refine with a description →