robots-txt-ai-crawler-audit

Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI

Install

One-Click Install

Add this to your `claude_desktop_config.json` file:

{
  "mcpServers": {
    "robots-txt-ai-crawler-audit": {
      "command": "npx",
      "args": [
        "@readystack/robots-txt-ai-crawler-audit"
      ]
    }
  }
}

Runnable packages

npm@readystack/robots-txt-ai-crawler-audit0.1.3stdio

What it can do

Tool inventory

No publishable tool enumeration has been recorded.

Community

Rate this Server

Evidence

Recent observations

This server has Registry metadata but no public verification run yet.