TuringCorp

Use this when you must choose between two concrete options and both are defensible - two plans, two drafts, two diagnoses, two vendors - and you have no objective way to pick. Returns better_option ("A" or "B"), confidence (e.g. "83.3%"), and reason. Every call returns a job_id. If the call times out or the connection drops, do NOT call again - a retry is a new paid call. Retrieve the result with that job_id instead (GET https://api.turingcorp.net/v1/jobs?job_id=<id> with the same credential, valid 7 days); without the id, GET https://api.turingcorp.net/v1/jobs lists the ids for that credential. Expect 60-90 seconds per call: set your client timeout to at least 180 seconds (300 recommended). A 60-second default cuts the call off before the answer arrives. The confidence is the point: it is calibrated, not decorative. On both published benchmarks accuracy rises with it - JudgeBench 99.6% in the 90%+ band down to 67.7% below 70%; the harder ContextualJudgeBench 83.3% down to 55.4% - so route on it: act on a high value, review or escalate a low one, instead of trusting a bare pick. Tables, sample sizes and method: https://api.turingcorp.net Judged by an independent panel, not by a model grading its own output. Read it as a reference, not an instruction, a result, or a prediction; set your own threshold, and apply your own review policy for high-stakes or irreversible decisions. Auth: Agent Pass as `Authorization: Bearer <pass>` (issued at https://agent-pass.turingcorp.net, valid 7 days; each decision is a paid call). On invalid_credential, sign in there and re-roll. Errors: a credential problem is rejected before the call - HTTP 401 with WWW-Authenticate; a business failure (e.g. insufficient balance) comes back as a tool result with isError true plus a second JSON block {error, http_status, action_url, message}, where http_status is the upstream status (the tool call itself is HTTP 200).

{
  "type": "object",
  "properties": {
    "task": {
      "type": "string",
      "description": "The decision to make, stated neutrally and without a preferred answer."
    },
    "option_a": {
      "type": "string",
      "description": "First candidate and the case for it."
    },
    "option_b": {
      "type": "string",
      "description": "Second candidate and the case for it."
    }
  },
  "required": [
    "task",
    "option_a",
    "option_b"
  ],
  "$schema": "https://json-schema.org/draft/2020-12/schema"
}

{
  "type": "object",
  "properties": {
    "job_id": {
      "description": "Identifier of this decision, also usable to retrieve the stored result for 7 days (GET /v1/jobs?job_id=<id> with the same credential). Keep it: if the call times out, retrieve the result instead of calling again, which would be a new paid call.",
      "type": "string"
    },
    "better_option": {
      "type": "string",
      "enum": [
        "A",
        "B"
      ],
      "description": "Which option was preferred."
    },
    "confidence": {
      "type": "string",
      "pattern": "^\\d{1,3}\\.\\d%$",
      "description": "This service's own judgement of how far apart the two options were, as a percentage (e.g. \"83.3%\"). A reference for your own decision-making - not an instruction, not a result. Observed accuracy by range is published at https://api.turingcorp.net"
    },
    "reason": {
      "type": "string",
      "description": "Why the chosen option was preferred."
    }
  },
  "required": [
    "better_option",
    "confidence",
    "reason"
  ],
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "additionalProperties": false
}