AI Search Readiness Checker

What it does

Free tool: paste any URL and instantly check if your robots.txt is accidentally blocking Google, Bing, ChatGPT, Perplexity, or Claude — plus whether you're ready for Cloudflare's Sept 15, 2026 AI crawler policy change.

Free tool: paste any URL and instantly check if your robots.txt is accidentally blocking Google, Bing, ChatGPT, Perplexity, or Claude — plus whether you

On September 15, 2026, Cloudflare changes the default AI-crawler policy for any site running ads: Training and Agent crawlers get blocked by default — and because Googlebot is a multi-purpose crawler (it indexes for Search and feeds Google's AI), an overly broad block can catch it too. Most site owners have never heard of this. Paste your URL below to check where you stand right now — takes about 3 seconds, no sign-up. Google now shows an AI Overview on roughly half of US searches, and ChatGPT, Perplexity, and Apple Intelligence all actively crawl the web to answer questions in real time. If your site blocks these crawlers — even by accident, via an overly broad wildcard rule — you're…from edgeplatformreview.com

• 
  AI Search Crawler Check2025 · llmseoindex.com · ▲181

  Check if your robots.txt allows ChatGPT, Google Gemini

• 
  Free AI SEO AuditorMay 2026 · freeaiseoaudit.com · ▲166

  Audit your site for the AI search era. 100% Open Source

• 
  CrawlerCheck2025 · crawlercheck.com · ▲16

  Since the last Show HN 7 months ago, I've shipped some major updates: • Operators Directory – browse 160+ crawlers by company (Google, OpenAI, Anthropic, etc.). See all their bots, safety stats, and official docs in one place. • Enhanced crawler profiles with "Blocking Impact" analysis and common use cases • Added 25+ new AI crawlers including latest models and scrapers • Bulk robots.txt generator – generate allow/block rules for all filtered bots in one click • RFC 9309 strict compliance – mimics Googlebot's exact "Longest Match" logic The tool now helps answer "who owns CCBot?" or…

• 
  GeoPromptTrackerJul 2026 · geoprompttracker.com · ▲4

  Directory of all 28 AI crawlers — GPTBot, ClaudeBot, PerplexityBot, Google-Extended and more — with robots.txt rules to allow or block each one.

• 
  Robots.txt TesterFeb 2026 · devhackes.tech · ▲2

  Test Googlebot, Bingbot, or any custom user-agent instantly

• 
  Bot Check2025 · graydonschwartz.com · ▲7

  Protect your blog and creative work from AI scrapers

• 
  /dev/null▲484

  a social network for devs

  Dev tools · 3d ago · dev-null.sh

• 
  Whiteboard (YC W26) – an open-source IDE for thoughtful software design▲423

  open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

  Dev tools · 28d ago · github.com

• 
  Reladraw – A diagram language where you decide where to place things▲411

  Contribute to reladraw/reladraw development by creating an account on GitHub.

  Dev tools · 26d ago · github.com

• 
  OpenBot▲362

  Grok Bot alternative: free, local, open-source, multiplayer

  Dev tools · 23d ago · openbot.run

• 
  Talanoa▲346

  Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

  Dev tools · 21d ago · talanoa.email

• 
  CoreSpeed▲332

  One MCP for everything your agents need: apps, memory, tools

  Dev tools · 28d ago · corespeed.io

• IR
  I replaced a $120k bowling center system with $1,600 in ESP32s▲2,935

  I might be the only SRE on Earth with his own bowling center. It's a more in-depth gig than you'd think. My family and I bought an abandoned 8-lane bowling center in the rural mid-west. In our small town there weren't many recreation options for families. You've heard of a food desert? This is an R&R desert. It had been abandoned for a good reason. The roof leaks, the electrical system was constantly surging, and my 70-year-old bowling equipment (still) doesn't work perfectly. The system that keeps your score is particularly interesting to me. It's the thing you watch during your game, but…

  Life & fun · Jul 2026

• 
  Elevators▲1,680

  How elevators push your buttons

  Life & fun · Jul 2026 · john.fun

• 
  18 Words▲1,160

  Play 18 Words, the free daily word puzzle. The official home is 18words.com. Tap Play now to open today

  Life & fun · Jul 2026 · 18words.com

• BA
  Bento - An entire PowerPoint in one HTML file (edit+view+data+collab)▲1,033

  Over the past few months, our team has been building more and more slidedecks using web frontend technologies with coding harnesses like Claude Code, but a common complaint is to make even small edits we need to edit the code either manually or via the harness. To avoid this loop, I ended up creating Bento, a single HTML file with everything you need in a slide tool including animations and shared editing. There's no install or cloud login, everything works offline. The default deck is around 560 KB and it doesn't need to fetch anything once you got it. Open it in a browser and then you can…

  Dev tools · Jul 2026 · bento.page

• 
  Getting GLM 5.2 running on my slow computer▲937

  A few days ago I found myself trying out GLM 5.2 and was really positively impressed. The capabilities and security I was getting from this LLM are similar to those I've gotten from models like Claude or GPT, and this really surprised me. But then I thought, "I wonder how it would work on a normal computer like mine," and above all, "I wonder if it would work without going into OOM on a computer like mine." So I started working with the help of agents to test this possibility. I started converting the model to int4, understanding MTP usage, and if possible implementing DSA for long context.…

  AI · Jul 2026 · github.com

• 
  OpenSEO▲928

  Hello! For the last 2 months, I've been building OpenSEO. It's a user friendly UI wrapping the DataForSEO API which has high quality SEO data for keywords, backlinks, AI SEO and competitor research. Instead of paying $100+ per month, you buy DataForSEO credits and pay only for usage. The coolest thing about the project so far has been hearing about what people are building on top of it. People are using coding agents to quickly integrate with Google Search Console, Google Ads and building their own AI SEO and reporting features. Many were already building their own custom solutions around…

  Dev tools · Jul 2026 · openseo.so