SiteOne Crawler – in-depth website analyzer and exporter (open-source)
Please try out this website analyzer and provide feedback on how to improve the output report so that you love the tool. In the first few sentences of the README you will also find a link to the GUI application if you don't want the CLI. To give you an idea of the report, I am sending a sample HTML report for Apple.com - https://crawler.siteone.io/html/2024-08-19/forever/v-bnb7tu5...
SiteOne Crawler – in-depth website analyzer and exporter (open-source) launched on August 19, 2024 with 32 votes, #844 of 5,471 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 2 years on.
In plain words
SiteOne Crawler is an open-source website analyzer and exporter that scans websites and generates detailed reports. It offers both a command-line interface and a graphical application for users who prefer not to use the CLI. The tool produces comprehensive HTML reports documenting website structure and data, making it useful for developers and website auditors who need to understand site composition and performance metrics.
written from the facts on this page · September 2026
From the sources
SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineers, and consultants. Supports Windows, macOS, and Linux (x64 and arm64). - janreges/siteone-crawler
Does a similar job
all alternatives →
Crawler.shMar 2026 · crawler.sh · ▲349Ultra-fast desktop & CLI app that finds your SEO & AEO issues and allows you to extract your content as Markdown
- SASitebulb, a website crawler and auditor for SEOs2017 · sitebulb.com · ▲120
Sitebulb is the revolutionary website crawler for better SEO audits. Twice winner of Best Search Software Tool. Desktop & Cloud crawling without compromise!
Web scraping page analyzer2018 · apify.com · ▲166Performs analysis of a webpage to figure out the best way how to scrape its data. Provide a URL and data points to find and get back a detailed dashboar...
More dev tools this month
the category →
open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.
Dev tools · 29d ago · github.com
Contribute to reladraw/reladraw development by creating an account on GitHub.
Dev tools · 27d ago · github.com
Contribute to oosexgang/hackios-xnu-kernel development by creating an account on GitHub.
Dev tools · 15h ago · github.com
OpenBot▲362Grok Bot alternative: free, local, open-source, multiplayer
Dev tools · 24d ago · openbot.run
Talanoa▲346Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…
Dev tools · 21d ago · talanoa.email
Source: Show HN post ↗
Launched alongside, August 2024
the whole month →
Jupitrr AI▲1,195Jupitrr AI turns raw talking videos into scroll-stopping content for coaches and consultants. Research, script, record, edit, and publish in one app.
AI · 2024 · jupitrr.com
Hey there HN! We’re Joe and Stopa, and today we’re open sourcing InstantDB, a client-side database that makes it easy to build real-time and collaborative apps like Notion and Figma. Building modern apps these days involves a lot of schleps. For a basic CRUD app you need to spin up servers, wire up endpoints, integrate auth, add permissions, and then marshal data from the backend to the frontend and back again. If you want to deliver a buttery smooth user experience, you’ll need to add optimistic updates and rollbacks. We do these steps over and over for every feature we build, which can…
Dev tools · 2024 · github.com