MCP Selection Lab
Benchmark MCP tool selection with metadata-only routing, collision, abstention, and holdout checks.
Sollte ich dies verwenden
Qualität und Sicherheit
Basierend auf einer automatisierten Analyse der Tool-Definitionen und der Einhaltung des Protokolls.
Kontextkosten
Dies ist die ungefähre Anzahl der Tokens, die jedes Mal verbraucht werden, wenn die Tools des Servers in den Kontext eines Modells geladen werden. Höhere Werte verringern die Aufmerksamkeit, die für andere Aufgaben verfügbar ist.
Installieren
Installation mit einem Klick
Fügen Sie dies Ihrer Datei `claude_desktop_config.json` hinzu:
{
"mcpServers": {
"mcp-selection-lab": {
"url": "https://mcp-selection-lab-production.up.railway.app/mcp"
}
}
}Remote-Endpunkte
https://mcp-selection-lab-production.up.railway.app/mcpstreamable-httpWas es kann
Tool-Inventar
Tools (3)
🟢selection_lab_info
Get free service capabilities, limits, privacy and connection details; does not scan a target.
Eingabe-Schema
{
"type": "object",
"properties": {},
"title": "selection_lab_infoArguments"
}Ausgabe-Schema
{
"type": "object",
"additionalProperties": true,
"title": "selection_lab_infoDictOutput"
}🟡scan_mcp_metadata(mcp_url, source, internal_test)
Create a free public report of MCP tool-description routing collisions. Reads discovery metadata (initialize/tools/list) only; never calls target business tools or spends funds. Use a public HTTP(S) URL without credentials, query or fragment. Results use at most 12 tools and 24 generated cases, not a real-model evaluation. The returned report is enriched with agent_plan candidate description-only edits and a machine-readable rerun instruction. Candidate edits are not untouched-holdout proof. Reports persist and are public by link. For an existing report use get_selection_report. Set internal_test=true for owner/CI validation so it is excluded from public scans. source is a self-reported referral bucket, not identity verification.
Eingabe-Schema
{
"type": "object",
"properties": {
"mcp_url": {
"maxLength": 2048,
"minLength": 8,
"title": "Mcp Url",
"type": "string"
},
"source": {
"default": "other",
"maxLength": 32,
"title": "Source",
"type": "string"
},
"internal_test": {
"default": false,
"title": "Internal Test",
"type": "boolean"
}
},
"required": [
"mcp_url"
],
"title": "scan_mcp_metadataArguments"
}Ausgabe-Schema
{
"type": "object",
"additionalProperties": true,
"title": "scan_mcp_metadataDictOutput"
}🟢get_selection_report(report_id)
Read and agent-enrich an existing public scan report by id; no new target request or model call.
Eingabe-Schema
{
"type": "object",
"properties": {
"report_id": {
"pattern": "^[0-9a-f]{16}$",
"title": "Report Id",
"type": "string"
}
},
"required": [
"report_id"
],
"title": "get_selection_reportArguments"
}Ausgabe-Schema
{
"type": "object",
"additionalProperties": true,
"title": "get_selection_reportDictOutput"
}Community
Nachweis