Dev tools · alternatives · 2026
24 alternatives to Scrapy Real Time
Introducing ScrapyRT: An API for Scrapy Spiders - Make the most of your Scrapy spiders with ScrapyRT. Explore its functionalities as an API for seamless integration.
Scrapy Real Time is an open-source API tool that enables developers to extract data from web pages on demand using existing Scrapy spiders. Built for web scraping teams who need to retrieve updated information from… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 1 we have checked on their own sites, 1 of them free or with a free tier. Scrapy Real Time launched in 2015; newer entries below may have overtaken it.
- 1
- 2
- 3
Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…
2022 · crawlee.dev · its alternatives →
- 4
- 5
Simple Scraper▲556Turn any website into an API in just a few seconds.
2019 · simplescraper.io · its alternatives →
- 6
- 7
- 8
Spider Free▲354Turn websites into organized data without code.
2019 · chromewebstore.google.com · its alternatives →
- 9
Web Scraper API▲287Scrape the web at scale without getting blocked
2021 · datashake.com · its alternatives →
- 10
- 11
- 12
ScrapX▲356Stay ahead of your competitors - Our service tracks the websites you select on a daily basis and notifies you of any changes, whether it's a new headline or a new product that's been released.
2023 · scrapx.io · its alternatives →
- 13
The easiest web scraping API on the web
2019 · scrapingbee.com · its alternatives →
- 14
Turn any website into an API (for those who miss Kimono)free tier, from $19/mo▲332Web scraping made simple — extract data with our free Chrome extension and powerful cloud platform. Turn websites into structured data at scale, via dashboard or API.
2019 · simplescraper.io · its alternatives →
- 15
Agenty▲263Point and click screen scraping tool using CSS selectors
2016 · agenty.com · its alternatives →
- 16
- 17
Scrappey.com▲80We handle all annoying scraping stuff for you
2023 · scrappey.com · its alternatives →
- 18
- 19
WebAutomation.io▲154The biggest marketplace of readymade no code web scrapers
2021 · webautomation.io · its alternatives →
- 20
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headf
2018 · github.com · its alternatives →
- 21
A Powerful Spider(Web Crawler) System in Python. Contribute to binux/pyspider development by creating an account on GitHub.
2014 · github.com · its alternatives →
- 22
Learn how to scrape webpages using Puppeteer and Serverless Functions built with OpenFaaS.
2020 · openfaas.com · its alternatives →
- 23
Scraper AI▲190Automate website data extraction in a few clicks
2020 · scraper.ai · its alternatives →
- 24
Hey all! I'm building these collection of APIs to help query SERP, PDP and Reviews data from Ecommerce sites solo since the past few years. I have hundreds of customers and revenue. ScrapingBee (a popular scraping API service) has started copying me now so I thought of doing a Show HN finally. Please butcher my product. I'd really appreciate your feedback. Do reach out via email if you'd like extra free credits, will add them to your account if your email address doesn't look like spam.
2024 · docs.unwrangle.com · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →