nowfound

Growth · July 8, 2019

Website Crawler

Online crawling and data extraction

Website Crawler launched on July 8, 2019 with 8 votes, #823 of 2,590 launches that month and more than 50% of that year's launches. The site was still online in September 2026, 7 years on.

What it does

Find on page SEO issues on the pages of your website with this free online real-time website crawler.

Crawl, anaylze, extract website data online for free. Get structed LLM ready JSON format data or data in CSV format of websites.

Website Crawler is a SaaS (Software as a Service) platform that crawls and analyzes web pages in real-time, detecting technical issues that are hard to find manually. Free plan supports up to 10 pages, while the paid plans scale up to a million. Export your data in JSON or CSV files, and run crawls as often as your daily limit allows. Website Crawler displays the analysis in a pie & bar charts, making it easy to find areas that need optimization. It generates a chart for loading times, internal/external links, HTTP status codes, content, etc. If you spot an issue, re-run a crawl and see the latest results. Our charts are updated in real-time. You can compare the current charts with the past…from websitecrawler.org
  • Crawly2016 · crawly.diffbot.com · ▲606

    Never write another web scraper

  • Online Web Scraper2016 · datascraping.co · ▲245

    Crawl password protected websites using CSS Selectors

  • Spider Free2019 · chromewebstore.google.com · ▲354

    Turn websites into organized data without code.

  • Crawlify2020 · crawlify.io · ▲165

    AI powered data extraction APIs. Hassle-free data retrieval.

  • ScrapeAll2022 · ▲87

    Automated web data scraper

  • Web Scraper2019 · apify.com · ▲19

    Crawls websites using Chrome and extracts data from pages using JavaScript. Supports recursive crawling and URL lists and automatically manages concurre...

More growth this month

the category →
  • Cedric is the AI employee that connects to all your tools, remembers everything about your company and workflow context, and does real work for the whole team.

    Growth · 26d ago · meet-cedric.com

  • Live and replayable map of U.S. air traffic during the FAA nationwide ground stop of Nov 13, 2026: flights airborne against a normal Friday, departures, and the backlog at major airports.

    Growth · 9d ago · grounds.top

  • Put your revenue and product analytics metrics in the notch

    Growth · 25d ago · notchmetrics.com

Is Website Crawler yours? Feature it on the home page: $19, or free with the badge →

Source: Product Hunt launch ↗

Launched alongside, July 2019

the whole month →
  • Tandem▲919

    A virtual office for remote & distributed teams

    Dev tools · 2019 · tandem.chat

  • The no-code membership platform for any website

    Dev tools · 2019 · memberstack.com

  • 900+ Screenshots of the best SaaS landing pages

    Growth · 2019 · saaspages.xyz

  • Stonly▲742

    A set of no-code tools for interactive onboarding & adoption

    Growth · 2019 · stonly.com

  • Super-summer music website inspired by a '90s OS

    Life & fun · 2019 · v2.poolside.fm

  • Really good curated email design and code inspiration

    Dev tools · 2019 · reallygoodemails.com