Paired-Twin Change Trials
Checkpoint-paired twin trials for agent fleet changes with blinded verdicts.
Sollte ich dies verwenden
Qualität und Sicherheit
Befunde (1)
- LOWTool 'trial_unblind' description lacks action verbin trial_unblind
Basierend auf einer automatisierten Analyse der Tool-Definitionen und der Einhaltung des Protokolls.
Kontextkosten
Dies ist die ungefähre Anzahl der Tokens, die jedes Mal verbraucht werden, wenn die Tools des Servers in den Kontext eines Modells geladen werden. Höhere Werte verringern die Aufmerksamkeit, die für andere Aufgaben verfügbar ist.
Installieren
Installation mit einem Klick
Fügen Sie dies Ihrer Datei `claude_desktop_config.json` hinzu:
{
"mcpServers": {
"paired-twin-change-trials-for-agents": {
"url": "https://textforagents.com/products/paired-twin-change-trials-for-agents/mcp"
}
}
}Remote-Endpunkte
https://textforagents.com/products/paired-twin-change-trials-for-agents/mcpstreamable-httpWas es kann
Tool-Inventar
Tools (7)
⚪trial_register_protocol(protocol, checkpoint, treated_config)
Register a hash-bound trial protocol; twins fork from the identical checkpoint, exactly one registered variable may differ.
Eingabe-Schema
{
"type": "object",
"properties": {
"protocol": {
"type": "object"
},
"checkpoint": {
"type": "object"
},
"treated_config": {
"type": "object"
}
},
"required": [
"protocol",
"checkpoint",
"treated_config"
]
}⚪trial_fork_pair(trial_id, task)
Fork a checkpoint-paired assignment for one task (blinded arms A/B).
Eingabe-Schema
{
"type": "object",
"properties": {
"trial_id": {
"type": "string"
},
"task": {
"type": "object"
}
},
"required": [
"trial_id",
"task"
]
}⚪trial_run_pair(trial_id, task)
Run one pair with the deterministic scripted agent and score blind. $0.25/pair, first 10 free once per operator.
Eingabe-Schema
{
"type": "object",
"properties": {
"trial_id": {
"type": "string"
},
"task": {
"type": "object"
}
},
"required": [
"trial_id",
"task"
]
}🟡trial_submit_outputs(trial_id, task, control_output, treated_output)
Submit the operator twins' outputs for one pair; blinded deterministic scoring. $0.25/pair, first 10 free once per operator.
Eingabe-Schema
{
"type": "object",
"properties": {
"trial_id": {
"type": "string"
},
"task": {
"type": "object"
},
"control_output": {},
"treated_output": {}
},
"required": [
"trial_id",
"task",
"control_output",
"treated_output"
]
}🟡trial_score(trial_id, task, control_output, treated_output)
Alias of trial_submit_outputs (blinded scoring).
Eingabe-Schema
{
"type": "object",
"properties": {
"trial_id": {
"type": "string"
},
"task": {
"type": "object"
},
"control_output": {},
"treated_output": {}
},
"required": [
"trial_id",
"task",
"control_output",
"treated_output"
]
}⚪trial_verdict(trial_id)
Trial verdict under the enforced stopping rule.
Eingabe-Schema
{
"type": "object",
"properties": {
"trial_id": {
"type": "string"
}
},
"required": [
"trial_id"
]
}⚪trial_unblind(trial_id)
Unblind after the verdict; hashed signed receipt covering every pair.
Eingabe-Schema
{
"type": "object",
"properties": {
"trial_id": {
"type": "string"
}
},
"required": [
"trial_id"
]
}Community
Nachweis