SCRIPTMASTERLABS — Calibration Court
Calibration Court MCP: model calibration leaderboard, ledger verify, paid recalibration via x402.
我该使用它吗
质量与安全性
发现（2）
- LOWTool 'court_model_report' description lacks action verb在 court_model_report 中
- LOWTool 'court_calibrate_labels' description lacks action verb在 court_calibrate_labels 中
基于对工具定义和协议合规性的自动分析。
上下文开销
这是每次将服务器的工具加载到模型上下文窗口时所消耗的大致 token 数。数值越高，可用于其他任务的注意力就越少。
安装
一键安装
将以下内容添加到你的 `claude_desktop_config.json` 文件中：
{
"mcpServers": {
"calibration-court": {
"url": "https://calibration-court.onrender.com/mcp"
}
}
}远程端点
https://calibration-court.onrender.com/mcpstreamable-http它能做什么
工具清单
工具（5）
🟢court_leaderboard(task_type)
Live ranking of decision models by Brier score on resolved real-world questions. Free. Returns empty lists when nothing has resolved.
输入模式
{
"type": "object",
"properties": {
"task_type": {
"type": "string"
}
}
}🟢court_model_report(model, task_type)
Calibration report for one model: Brier, ECE, reliability bins with Wilson intervals, overconfidence, drift. Free.
输入模式
{
"type": "object",
"properties": {
"model": {
"type": "string"
},
"task_type": {
"type": "string"
}
},
"required": [
"model"
]
}🟢court_verify_ledger
Recompute the SHA-256 hash chain and cross-check derived tables. Free.
输入模式
{
"type": "object",
"properties": {}
}🟢court_recalibrate(model, prob, task_type)
Paid (x402, USDC on Base). Map a model's raw probability to an empirically calibrated one using resolved outcomes on the ledger. Refuses with insufficient_data below 30 samples.
输入模式
{
"type": "object",
"properties": {
"model": {
"type": "string"
},
"prob": {
"type": "number",
"minimum": 0,
"maximum": 1
},
"task_type": {
"type": "string"
}
},
"required": [
"model",
"prob"
]
}🟢court_calibrate_labels(examples, probs)
Paid (x402, USDC on Base). Fit isotonic calibration on YOUR labelled outcomes ({p,y} pairs) and recalibrate the given probabilities. Stateless; nothing is stored.
输入模式
{
"type": "object",
"properties": {
"examples": {
"type": "array",
"items": {
"type": "object",
"properties": {
"p": {
"type": "number"
},
"y": {
"type": "integer",
"enum": [
0,
1
]
}
},
"required": [
"p",
"y"
]
}
},
"probs": {
"type": "array",
"items": {
"type": "number"
}
}
},
"required": [
"examples",
"probs"
]
}社区
证据