SEO Crawler

What it does

SEO Crawler is a fast, respectful website crawler built for developers, founders, and agencies who want clear, actionable insight into how their site is actually performing. We scan your entire website, discover every internal and external link, detect SEO and technical issues, and surface AI-powered recommendations to help you fix problems before they impact rankings or users.

• 
  Crawler.shMar 2026 · crawler.sh · ▲349

  Ultra-fast desktop & CLI app that finds your SEO & AEO issues and allows you to extract your content as Markdown

• 
  CrawlRavenJul 2026 · crawlraven.com · ▲287

  SEO Hub for GSC + GA4 + a 200-point crawl

• 
  Crawlee2022 · crawlee.dev · ▲229

  Build reliable web scrapers and robots, fast!

• AT
  A Twitter crawler for app ideas2021 · iwishtherewas.app · ▲272
• SA
  Sitebulb, a website crawler and auditor for SEOs2017 · sitebulb.com · ▲120

  Sitebulb is the revolutionary website crawler for better SEO audits. Twice winner of Best Search Software Tool. Desktop & Cloud crawling without compromise!

• 
  SEO Quickr2023 · ▲101

  AI-powered SEO for everyone.

• 
  WallHop – 12ft.io is gone, so I built a replacement▲287

  wallhop is a free paywall bypass. Paste any article link to read it without paywall popups, ads or clutter. No signup, no extension. A simple 12ft.io alternative.

  Growth · 11d ago · wallhop.io

• 
  Prefer▲201

  The execution layer for AEO

  Growth · 23d ago · tryprefer.com

• 
  MakerMap▲197

  A living map of makers and what they’re building

  Growth · 26d ago · makermap.lol

• GP
  Gemini Pro 3 imagines the HN front page 10 years from now▲3,346

  Life & fun · Dec 2025 · dosaygo-studio.github.io

• 
  Jmail – Google Suite for Epstein files▲1,557

  Hi everyone! My name's Luke and I made the original Jmail here alongside Riley Walz. We had a ton of friends collaborate on building out more of the app suite last night in lieue of DOJ's "Epstein files" release. Please AMA!

  Life & fun · Dec 2025 · jmail.world

• 
  Loki.Build▲743

  Design and ship studio-grade landing pages with AI

  AI · Dec 2025 · loki.build

• 
  PlanEat AI▲733

  AI turns your health goals into a 7-day menu & grocery list

  AI · Dec 2025 · planeatai.com

• 
  22 GB of Hacker News in SQLite▲730

  Community, All the HN belong to you. This is an archive of hacker news that fits in your browser. When I made HN Made of Primes I realized I could probably do this offline sqlite/wasm thing with the whole GBs of archive. The whole dataset. So I tried it, and this is it. Have Hacker News on your device. Go to this repo (https://github.com/DOSAYGO-STUDIO/HackerBook): you can download it. Big Query -> ETL -> npx serve docs - that's it. 20 years of HN arguments and beauty, can be yours forever. So they'll never die. Ever. It's the unkillable static archive of HN and it's…

  Dev tools · Dec 2025 · hackerbook.dosaygo.com

• 
  CyberCut AI▲723

  AI video studio for viral social clips

  AI · Dec 2025 · cybercut.ai