Scrapy Real Time
Introducing ScrapyRT: An API for Scrapy Spiders - Make the most of your Scrapy spiders with ScrapyRT. Explore its functionalities as an API for seamless integration.
Scrapy Real Time launched on January 22, 2015 with 37 votes and more than 90% of that year's launches. The site was still online in September 2026, 11 years on.
In plain words
Scrapy Real Time is an open-source API tool that enables developers to extract data from web pages on demand using existing Scrapy spiders. Built for web scraping teams who need to retrieve updated information from previously crawled pages, it allows reuse of existing spider code through a straightforward API interface. The tool simplifies the process of getting fresh data without rebuilding scraping infrastructure.
written from the facts on this page · September 2026
From the sources
Zyte Developer community meetup #2 x Humanbound.ai - Ship agents that survive the real web Introducing ScrapyRT: An API for Scrapy Spiders - Make the most of your Scrapy spiders with ScrapyRT. Explore its functionalities as an API for seamless integration. We’re proud to announce our new open source project, ScrapyRT ! ScrapyRT, short for Scrapy Real Time, allows you to extract data from a single web page via an API using your existing Scrapy spiders. We needed to be able to retrieve the latest data for a previously scraped page, on demand. ScrapyRT made this easy by allowing us to reuse our spider logic to extract data from a single page, rather than running the whole crawl again. ScrapyRT…from blog.scrapinghub.com
Does a similar job
all alternatives →
Crawlee – Web scraping and browser automation library for Node.js2022 · crawlee.dev · ▲282Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…
More dev tools this month
the category →
open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.
Dev tools · 27d ago · github.com
Contribute to reladraw/reladraw development by creating an account on GitHub.
Dev tools · 25d ago · github.com
OpenBot▲362Grok Bot alternative: free, local, open-source, multiplayer
Dev tools · 22d ago · openbot.run
Talanoa▲343Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…
Dev tools · 20d ago · talanoa.email
CoreSpeed▲332One MCP for everything your agents need: apps, memory, tools
Dev tools · 28d ago · corespeed.io
Source: Show HN post ↗
Launched alongside, January 2015
the whole month →
A place to discover ideas that VCs & angels want to fund
Commerce · 2015 · docs.google.com
Send glitter to the people that deserve it
Life & fun · 2015 · shipyourenemiesglitter.com
