Screamingfrog's SEO Log File Analyser
Identify crawled URLs and analyse search bot data
Screamingfrog's SEO Log File Analyser launched on September 8, 2016 with 6 votes. The site was still online in September 2026, 10 years on.
What it does
The Screaming Frog SEO Log File Analyser allows you to upload your log files, verify search engine bots, identify crawled URLs and analyse search bot data and behaviour for invaluable SEO insight.
Analyse search engine and AI bot crawling with the industry leading Log File Analyser for Windows, macOS and Linux. The Screaming Frog SEO Log File Analyser allows you to upload your log files, verify search engine and AI bots, identify crawled URLs and analyse bot behaviour for invaluable SEO insight. Download and analyse 1k log events for free, or buy a licence for £99 Per Year to remove the limit. The Log File Analyser is light, but extremely powerful – able to process, store and analyse millions of lines of log file event data in a smart database. It gathers key log file data to allow SEOs to make informed decisions about search and AI bots. View and analyse exactly which URLs…from screamingfrog.co.uk
Does a similar job
all alternatives →
Screaming Frog SEO Spider2014 · screamingfrog.co.uk · ▲20Quickly analyse, audit and review a site’s code & onsite SEO
Screaming Frog SEO Spider Tool2017 · screamingfrog.co.uk · ▲14Onsite SEO tool to crawl website links, images, CSS, scripts
Crawler.shMar 2026 · crawler.sh · ▲349Ultra-fast desktop & CLI app that finds your SEO & AEO issues and allows you to extract your content as Markdown
- DRDontBeEvil.rip: Search, for developers (API, expressions, CLI)2022 · ▲269
I'd like to invite everyone to try out DontBeEvil.rip, an experimental search engine for developers. tl;dr $ alias rip="curl -G -H 'Accept: text/plain' --url https://dontbeevil.rip/search --data-urlencode " $ rip 'q=Heartbleed bug' DontBeEvil.rip is a year long experiment to see if a small team can build a developer-focused search engine that is self-sustaining on $10 monthly subscriptions. It works by only indexing high-quality resources that are relevant to developers. You won't get useless listicles because we'll never crawl them. Relevant urls are harvested from HN,…
More dev tools this month
the category →
Contribute to oosexgang/hackios-xnu-kernel development by creating an account on GitHub.
Dev tools · 6d ago · github.com
OpenBot▲362Grok Bot alternative: free, local, open-source, multiplayer
Dev tools · 29d ago · openbot.run
Talanoa▲346Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…
Dev tools · 26d ago · talanoa.email
Source: Product Hunt launch ↗
Launched alongside, September 2016
the whole month →
Startup Pitch Decks▲2,318Real decks from real startups that raised over $400M
Growth · 2016 · cirrusinsight.com
Bitmap & tilemap generation from a single example with the help of ideas from quantum mechanics - mxgmn/WaveFunctionCollapse
Life & fun · 2016 · github.com
Reproducing images with geometric primitives. Contribute to fogleman/primitive development by creating an account on GitHub.
Dev tools · 2016 · github.com
AccessURL▲818Share access to accounts without sending a username/password
Life & fun · 2016 · accessurl.com