MCP Selection Lab
Benchmark MCP tool selection with metadata-only routing, collision, abstention, and holdout checks.
使うべきか
品質と安全性
ツール定義とプロトコルへの準拠に関する自動分析に基づいています。
コンテキストコスト
これは、サーバーのツールがモデルのコンテキストに読み込まれるたびに消費されるおおよそのトークン数です。数が多いほど、ほかのタスクに使える注意が減ります。
インストール
ワンクリックインストール
これを `claude_desktop_config.json` ファイルに追加してください:
{
"mcpServers": {
"mcp-selection-lab": {
"url": "https://mcp-selection-lab-production.up.railway.app/mcp"
}
}
}リモートエンドポイント
https://mcp-selection-lab-production.up.railway.app/mcpstreamable-httpできること
ツール一覧
ツール（3）
🟢selection_lab_info
Get free service capabilities, limits, privacy and connection details; does not scan a target.
入力スキーマ
{
"type": "object",
"properties": {},
"title": "selection_lab_infoArguments"
}出力スキーマ
{
"type": "object",
"additionalProperties": true,
"title": "selection_lab_infoDictOutput"
}🟡scan_mcp_metadata(mcp_url, source, internal_test)
Create a free public report of MCP tool-description routing collisions. Reads discovery metadata (initialize/tools/list) only; never calls target business tools or spends funds. Use a public HTTP(S) URL without credentials, query or fragment. Results use at most 12 tools and 24 generated cases, not a real-model evaluation. The returned report is enriched with agent_plan candidate description-only edits and a machine-readable rerun instruction. Candidate edits are not untouched-holdout proof. Reports persist and are public by link. For an existing report use get_selection_report. Set internal_test=true for owner/CI validation so it is excluded from public scans. source is a self-reported referral bucket, not identity verification.
入力スキーマ
{
"type": "object",
"properties": {
"mcp_url": {
"maxLength": 2048,
"minLength": 8,
"title": "Mcp Url",
"type": "string"
},
"source": {
"default": "other",
"maxLength": 32,
"title": "Source",
"type": "string"
},
"internal_test": {
"default": false,
"title": "Internal Test",
"type": "boolean"
}
},
"required": [
"mcp_url"
],
"title": "scan_mcp_metadataArguments"
}出力スキーマ
{
"type": "object",
"additionalProperties": true,
"title": "scan_mcp_metadataDictOutput"
}🟢get_selection_report(report_id)
Read and agent-enrich an existing public scan report by id; no new target request or model call.
入力スキーマ
{
"type": "object",
"properties": {
"report_id": {
"pattern": "^[0-9a-f]{16}$",
"title": "Report Id",
"type": "string"
}
},
"required": [
"report_id"
],
"title": "get_selection_reportArguments"
}出力スキーマ
{
"type": "object",
"additionalProperties": true,
"title": "get_selection_reportDictOutput"
}コミュニティ
エビデンス