ActableSite AI Crawler Monitor
Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.
Should I use this
Quality & Safety
Based on automated analysis of tool definitions and protocol compliance.
Context Cost
This is the approximate number of tokens consumed each time the server's tools are loaded into a model's context. Higher counts reduce the attention available for other tasks.
Install
One-Click Install
Add this to your `claude_desktop_config.json` file:
{
"mcpServers": {
"ai-crawler-robots-monitor": {
"url": "https://actablesite.com/mcp/"
}
}
}Remote endpoints
https://actablesite.com/mcp/streamable-httpWhat it can do
Tool inventory
Tools (5)
🟢audit_public_website(url)
Run ActableSite's free three-signal readiness scan for a public website. Returns observable evidence for business identity, semantic reading path, and explicit action path. This does not guarantee AI crawling, indexing, citation, ranking, recommendation, traffic, or revenue.
Input Schema
{
"type": "object",
"properties": {
"url": {
"type": "string",
"description": "Public HTTP or HTTPS website URL. Private, local-network, authenticated, and restricted targets are rejected."
}
},
"required": [
"url"
],
"additionalProperties": false
}🟢check_ai_crawler_policy(url)
Check the homepage robots.txt rule for eight named OpenAI, Anthropic, Perplexity, and Google AI crawler tokens. The free result stays complete and includes a bounded optional handoff to exact monitoring terms. Results describe robots policy only and do not prove network access, authentic bot identity, crawling, indexing, citation, or ranking.
Input Schema
{
"type": "object",
"properties": {
"url": {
"type": "string",
"description": "Public HTTP or HTTPS website URL. Private and local-network targets are rejected."
}
},
"required": [
"url"
],
"additionalProperties": false
}🟢get_crawler_watch_offer
Return the exact $9 monthly price, one-site scope, 15-minute check cadence, two-check confirmation, delivery and cancellation paths, and synthetic-check limitations. This tool is informational: present the offer and require explicit user confirmation before any separate checkout or purchase action.
Input Schema
{
"type": "object",
"properties": {},
"additionalProperties": false
}🟢get_full_report_offer
Return the exact one-time price, deliverables, delivery path, checkout URL, support contact, and limitations for ActableSite's paid 15-check repair report. Present this information to the user and require explicit user confirmation before opening checkout or attempting any purchase.
Input Schema
{
"type": "object",
"properties": {},
"additionalProperties": false
}🟢get_practice_radar_offer
Return the current Practice Radar weekly-edition receipt, public sample, exact $19 one-time and $39 monthly options, included fields, delivery and cancellation paths, and material NPI limitations. This tool is informational: it cannot open checkout or purchase. Present the offer and require explicit user confirmation before any separate checkout or purchase action.
Input Schema
{
"type": "object",
"properties": {},
"additionalProperties": false
}Community
Evidence