Paired-Twin Change Trials
Checkpoint-paired twin trials for agent fleet changes with blinded verdicts.
¿Debería usar esto?
Calidad y seguridad
Hallazgos (1)
- LOWTool 'trial_unblind' description lacks action verben trial_unblind
Basado en el análisis automatizado de las definiciones de herramientas y el cumplimiento del protocolo.
Costo de contexto
Este es el número aproximado de tokens que se consumen cada vez que las herramientas del servidor se cargan en el contexto de un modelo. Los recuentos más altos reducen la atención disponible para otras tareas.
Instalar
Instalación con un clic
Agrega esto a tu archivo `claude_desktop_config.json`:
{
"mcpServers": {
"paired-twin-change-trials-for-agents": {
"url": "https://textforagents.com/products/paired-twin-change-trials-for-agents/mcp"
}
}
}Puntos de conexión remotos
https://textforagents.com/products/paired-twin-change-trials-for-agents/mcpstreamable-httpQué puede hacer
Inventario de herramientas
Herramientas (7)
⚪trial_register_protocol(protocol, checkpoint, treated_config)
Register a hash-bound trial protocol; twins fork from the identical checkpoint, exactly one registered variable may differ.
Esquema de entrada
{
"type": "object",
"properties": {
"protocol": {
"type": "object"
},
"checkpoint": {
"type": "object"
},
"treated_config": {
"type": "object"
}
},
"required": [
"protocol",
"checkpoint",
"treated_config"
]
}⚪trial_fork_pair(trial_id, task)
Fork a checkpoint-paired assignment for one task (blinded arms A/B).
Esquema de entrada
{
"type": "object",
"properties": {
"trial_id": {
"type": "string"
},
"task": {
"type": "object"
}
},
"required": [
"trial_id",
"task"
]
}⚪trial_run_pair(trial_id, task)
Run one pair with the deterministic scripted agent and score blind. $0.25/pair, first 10 free once per operator.
Esquema de entrada
{
"type": "object",
"properties": {
"trial_id": {
"type": "string"
},
"task": {
"type": "object"
}
},
"required": [
"trial_id",
"task"
]
}🟡trial_submit_outputs(trial_id, task, control_output, treated_output)
Submit the operator twins' outputs for one pair; blinded deterministic scoring. $0.25/pair, first 10 free once per operator.
Esquema de entrada
{
"type": "object",
"properties": {
"trial_id": {
"type": "string"
},
"task": {
"type": "object"
},
"control_output": {},
"treated_output": {}
},
"required": [
"trial_id",
"task",
"control_output",
"treated_output"
]
}🟡trial_score(trial_id, task, control_output, treated_output)
Alias of trial_submit_outputs (blinded scoring).
Esquema de entrada
{
"type": "object",
"properties": {
"trial_id": {
"type": "string"
},
"task": {
"type": "object"
},
"control_output": {},
"treated_output": {}
},
"required": [
"trial_id",
"task",
"control_output",
"treated_output"
]
}⚪trial_verdict(trial_id)
Trial verdict under the enforced stopping rule.
Esquema de entrada
{
"type": "object",
"properties": {
"trial_id": {
"type": "string"
}
},
"required": [
"trial_id"
]
}⚪trial_unblind(trial_id)
Unblind after the verdict; hashed signed receipt covering every pair.
Esquema de entrada
{
"type": "object",
"properties": {
"trial_id": {
"type": "string"
}
},
"required": [
"trial_id"
]
}Comunidad
Evidencia