Robots.txt Report

What it does

This X (formerly Twitter) bot reports when relevant companies update robots.txt files. For a list of currently tracked companies, check the pinned post (DM for requests to be added). The robots.txt diff is uploaded in the post when a change is detected.

Tracking the latest information in Apple Robotics. Not affiliated with Apple Inc.

• 
  Robots.txt Generator2024 · generaterobotstxt.com · ▲378

  The right robots.txt file for your project

• RT
  robots.txt as a service, check web crawl rules through an API2019 · robotstxt.io · ▲17
• 
  Robots.txt Generator 2023 · techcopes.com · ▲18

  Create a robots.txt file for website instantly

• 
  Robots.txt Analyzer2025 · spider-web-flax.vercel.app · ▲7

  Simple Robots.txx Analyzer

• 
  AI Search Crawler Check2025 · llmseoindex.com · ▲181

  Check if your robots.txt allows ChatGPT, Google Gemini

• 
  Robots.txt Generator2024 · konigle.com · ▲7

  Free and powerful robots.txt generator tool

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 18d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 18d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 20d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 21d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 30d ago · world.pixverse.video

• 
  Beam.win▲378

  Run AI agents on one Mac and use its windows on another

  AI · 4d ago · beam.win

• 
  Wispr Flow▲2,732

  Speak naturally, write perfectly & 3x faster in every app

  AI · 2024 · wisprflow.ai

• 
  Pathway▲1,335

  Get user insights 10x faster

  Work · 2024 · wynde.io

• 
  BeforeSunset AI 2.0▲1,267

  Personalized AI daily planning that suits your life

  AI · 2024 · beforesunset.ai

• 
  Osmos▲1,194

  Match with like-minded professionals for 1:1 conversations

  Growth · 2024

• 
  Carrot Care▲1,168

  Understand & optimise your bloodwork

  Life & fun · 2024 · carrotcare.health

• 
  Polar▲1,167

  An open source monetization platform for developers

  Dev tools · 2024 · polar.sh