SpiderPro

What it does

Stop paying monthly fees for cloud crawlers. Spider Pro is a powerful desktop app (Win/Mac/Linux) to audit massive sites, detect broken links, and visualize internal linking. Includes Headless Chrome for full JS rendering.

• 
  Spider Pro2019 · ▲574

  The easiest way to scrape the internet.

• 
  INDEXED.pro2023 · indexed.pro · ▲169

  Smart, fast, automatic website URL indexing for SEO

• 
  Crawler.shMar 2026 · crawler.sh · ▲349

  Ultra-fast desktop & CLI app that finds your SEO & AEO issues and allows you to extract your content as Markdown

• 
  Crawlee2022 · crawlee.dev · ▲229

  Build reliable web scrapers and robots, fast!

• 
  A Python Spider System with Web UI2014 · github.com · ▲159

  A Powerful Spider(Web Crawler) System in Python. Contribute to binux/pyspider development by creating an account on GitHub.

• SA
  Sitebulb, a website crawler and auditor for SEOs2017 · sitebulb.com · ▲120

  Sitebulb is the revolutionary website crawler for better SEO audits. Twice winner of Best Search Software Tool. Desktop & Cloud crawling without compromise!

• 
  /dev/null▲490

  a social network for devs

  Dev tools · 4d ago · dev-null.sh

• 
  Run full iOS 16.5 firmware on Android Devices▲433

  Contribute to oosexgang/hackios-xnu-kernel development by creating an account on GitHub.

  Dev tools · 18h ago · github.com

• 
  Whiteboard (YC W26) – an open-source IDE for thoughtful software design▲423

  open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

  Dev tools · 29d ago · github.com

• 
  Reladraw – A diagram language where you decide where to place things▲411

  Contribute to reladraw/reladraw development by creating an account on GitHub.

  Dev tools · 27d ago · github.com

• 
  OpenBot▲362

  Grok Bot alternative: free, local, open-source, multiplayer

  Dev tools · 24d ago · openbot.run

• 
  Talanoa▲346

  Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

  Dev tools · 22d ago · talanoa.email

• GP
  Gemini Pro 3 imagines the HN front page 10 years from now▲3,346

  Life & fun · Dec 2025 · dosaygo-studio.github.io

• 
  Jmail – Google Suite for Epstein files▲1,557

  Hi everyone! My name's Luke and I made the original Jmail here alongside Riley Walz. We had a ton of friends collaborate on building out more of the app suite last night in lieue of DOJ's "Epstein files" release. Please AMA!

  Life & fun · Dec 2025 · jmail.world

• 
  Loki.Build▲743

  Design and ship studio-grade landing pages with AI

  AI · Dec 2025 · loki.build

• 
  PlanEat AI▲733

  AI turns your health goals into a 7-day menu & grocery list

  AI · Dec 2025 · planeatai.com

• 
  22 GB of Hacker News in SQLite▲730

  Community, All the HN belong to you. This is an archive of hacker news that fits in your browser. When I made HN Made of Primes I realized I could probably do this offline sqlite/wasm thing with the whole GBs of archive. The whole dataset. So I tried it, and this is it. Have Hacker News on your device. Go to this repo (https://github.com/DOSAYGO-STUDIO/HackerBook): you can download it. Big Query -> ETL -> npx serve docs - that's it. 20 years of HN arguments and beauty, can be yours forever. So they'll never die. Ever. It's the unkillable static archive of HN and it's…

  Dev tools · Dec 2025 · hackerbook.dosaygo.com

• 
  CyberCut AI▲723

  AI video studio for viral social clips

  AI · Dec 2025 · cybercut.ai