Robots.txt Tester

Test Googlebot, Bingbot, or any custom user-agent instantly

What it does

Test whether a URL is allowed or blocked by robots.txt rules for Googlebot and other crawlers.

AI Search Crawler CheckSep 2025 · ▲181
Check if your robots.txt allows ChatGPT, Google Gemini
Robots.txt Tester5d ago · devhackes.tech · ▲2
Test your robots.txt file for any bot, instantly & free
Robots.txt Generator2024 · ▲389
The right robots.txt file for your project
Robots.txt Validator & Testing ToolJul 2026 · loganmosby.com · ▲6
Validate robots.txt rules before you publish
LLM SEO Index Crawler Check2025 · ▲157
Check if your website can get crawled by ChatGPT
RT
robots.txt as a service, check web crawl rules through an API2019 · robotstxt.io · ▲17

Dograh▲592
The open source VAPI alternative
Dev tools · 25d ago · dograh.com
Meridian▲530
Don't let your work go unnoticed. Get promoted!
Dev tools · 20d ago · meridiona.com
x1▲516
Lovable for iPhone apps go from idea to App Store
Dev tools · 11d ago · x1.new
Computable GPU Index (CGI)▲424
The first open-source price index for GPU compute
Dev tools · 10d ago · getcomputable.com
Open-Source eInk Bike Computer▲403
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 2d ago · opentrailpaper.com
The GTM Co-Founder▲402
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com

Rork Max▲1,430
Best AI for iOS apps. Website that replaces Xcode
Life & fun · Feb 2026 · rork.com
happycapy▲1,367
The agent-native computer, for the rest of us
AI · Feb 2026 · happycapy.ai
SuperX▲902
All-in-one growth OS for serious 𝕏 creators
AI · Feb 2026 · superx.so
KiloClaw▲871
Hosted OpenClaw. No Mac mini required.
Dev tools · Feb 2026 · kilo.ai
Lovon AI Therapy▲802
Talk it out and feel better
AI · Feb 2026 · lovon.app
Claude Opus 4.6▲764
Claude’s most advanced model for agentic tasks
AI · Feb 2026 · anthropic.com