Parallel World
Check which AI bots a site's robots.txt allows; read-only facts about Parallel World
사용해야 할까요
품질 및 안전성
발견 사항 (2)
- HIGHTool poisoning patterns detected
- MEDIUMTool description contains URL to non-standard domaincheck_ai_bot_access에서
도구 정의와 프로토콜 준수에 대한 자동 분석을 기반으로 합니다.
컨텍스트 비용
이는 서버의 도구가 모델의 컨텍스트에 로드될 때마다 소비되는 대략적인 토큰 수입니다. 수치가 높을수록 다른 작업에 사용할 수 있는 주의가 줄어듭니다.
설치
원클릭 설치
`claude_desktop_config.json` 파일에 다음을 추가하세요:
{
"mcpServers": {
"parallel-world": {
"url": "https://pw.migurei.ai/mcp"
}
}
}원격 엔드포인트
https://pw.migurei.ai/mcpstreamable-http할 수 있는 일
도구 목록
도구 (2)
🟢get_site_info(topic)
Returns the facts published on this website, in Japanese: service overview, plans, prices and payment terms, how the scanner behaves, how to contact us, and the operating company. Each fact comes with the URL of the page that shows it. Read-only; it returns nothing that is not on the pages.
입력 스키마
{
"type": "object",
"properties": {
"topic": {
"type": "string",
"enum": [
"overview",
"pricing",
"scanner",
"contact",
"company",
"all"
],
"description": "Which facts to return"
}
},
"required": [
"topic"
],
"additionalProperties": false
}🟢check_ai_bot_access(domain)
Reads the public robots.txt of a website (one request to https://<host>/robots.txt, nothing else on the site) and says, for each AI crawler and AI agent of the migurei bot registry (training crawlers such as GPTBot and ClaudeBot, search bots, fetchers that act for a user, and others), whether that bot is allowed or disallowed for the path "/", which robots.txt rule decided it, and whether the file exists. Each bot also carries observed_on_pw: the counts our own lab site pw.migurei.ai recorded for that bot (published on https://pw.migurei.ai/ja/research/ai-bot-first-visits; the same for every domain, not about the domain asked, not a prediction). Input is a domain or URL; only public domain names are accepted (no IP addresses, no ports, no private hosts). Read-only; the domain is not stored. robots.txt is a request to bots, not access control, and a User-Agent is only a claim.
입력 스키마
{
"type": "object",
"properties": {
"domain": {
"type": "string",
"maxLength": 300,
"description": "A public domain name or a URL, for example example.com or https://example.com/page. Only its host is used."
}
},
"required": [
"domain"
],
"additionalProperties": false
}출력 스키마
{
"type": "object",
"properties": {
"domain": {
"type": "string"
},
"robots_url": {
"type": "string"
},
"robots_txt": {
"type": "object",
"properties": {
"state": {
"type": "string",
"enum": [
"found",
"not_found",
"unavailable"
]
},
"http_status": {
"type": [
"integer",
"null"
]
},
"error": {
"type": [
"string",
"null"
]
},
"redirects": {
"type": "integer"
},
"truncated": {
"type": "boolean"
},
"bytes": {
"type": "integer"
},
"possible_block": {
"type": "boolean"
}
},
"required": [
"state",
"http_status",
"error",
"redirects",
"truncated",
"bytes",
"possible_block"
]
},
"bots": {
"type": "array",
"items": {
"type": "object",
"properties": {
"bot": {
"type": "string"
},
"token": {
"type": "string"
},
"category": {
"type": "string",
"enum": [
"training",
"search_index",
"user_fetch",
"browser_agent",
"unknown"
]
},
"verdict": {
"type": "string",
"enum": [
"allowed",
"disallowed",
"unknown"
]
},
"basis": {
"type": "string",
"enum": [
"bot_group",
"wildcard_group",
"googlebot_group",
"no_group",
"no_robots_txt",
"robots_txt_unavailable"
]
},
"rule": {
"type": [
"string",
"null"
]
},
"path_rules": {
"type": "boolean"
},
"observed_on_pw": {
"type": "object",
"description": "What our lab saw this bot do on its own site pw.migurei.ai (counts published on the source page). Not about the domain asked, not a prediction. The same for every domain asked.",
"properties": {
"site": {
"type": "string"
},
"applies_to_queried_domain": {
"type": "boolean"
},
"observed": {
"type": "boolean"
},
"first_seen": {
"type": [
"string",
"null"
]
},
"last_seen": {
"type": [
"string",
"null"
]
},
"robots_txt_fetches": {
"type": [
"integer",
"null"
]
},
"pages_fetched": {
"type": [
"integer",
"null"
]
},
"sitemap_urls": {
"type": [
"integer",
"null"
]
},
"window": {
"type": "object",
"properties": {
"from": {
"type": "string"
},
"to": {
"type": "string"
}
},
"required": [
"from",
"to"
]
},
"as_of": {
"type": "string"
},
"source": {
"type": "string"
},
"code_sha": {
"type": "string"
},
"note_ja": {
"type": "string"
},
"note_en": {
"type": "string"
}
},
"required": [
"site",
"applies_to_queried_domain",
"observed",
"first_seen",
"last_seen",
"robots_txt_fetches",
"pages_fetched",
"sitemap_urls",
"window",
"as_of",
"source",
"code_sha",
"note_ja",
"note_en"
]
}
},
"required": [
"bot",
"token",
"category",
"verdict",
"basis",
"rule",
"path_rules"
]
}
},
"summary": {
"type": "object",
"properties": {
"allowed": {
"type": "integer"
},
"disallowed": {
"type": "integer"
},
"unknown": {
"type": "integer"
}
},
"required": [
"allowed",
"disallowed",
"unknown"
]
},
"registry_version": {
"type": "string"
},
"method": {
"type": "string"
},
"learn_more": {
"type": "string"
}
},
"required": [
"domain",
"robots_url",
"robots_txt",
"bots",
"summary",
"registry_version",
"method",
"learn_more"
]
}커뮤니티
증거