81trust / 100

Judge

by Typed judgment in Search & web

x402 APIPassing, checked 22 min ago

Ask a typed question about any content and get an answer your code can branch on, not prose to parse. Send state (the content, a string or object) and questions (your own ids mapped to question objects); get back answers keyed by those ids. Three question types: choice (pick one of your named options: returns choice, probabilities per option and confidence), score (a position on levels you describe, lowest first: returns score as a fractional level index, probabilities per level index.

POST
https://agent402.tools/v1/judge
Price
$0.001
per call in USDC
Uptime
100%
last 30 days
Response time
209 ms
537 ms slowest 5%
Last check
Passed
22 min ago, next in 10 min

Run a free test callHow to call it

Reliability

All checks passedSome failedAll failedNot checked

Status and outage history · Atom feed · Watch with other listings

How to call it

POST https://agent402.tools/v1/judge

Each call costs $0.001 in USDC on Base, paid with the request over x402.

Run a free test callOne unpaid request, the way an agent sends it. You see the payment challenge it gets back. Nothing is charged.

Example request

From the listing.

POST https://agent402.tools/v1/judge
content-type: application/json

{
  "questions": {
    "is_reproducible": {
      "instructions": "Does this report describe steps that would let an engineer reproduce the problem?",
      "type": "noul"
    },
    "severity": {
      "criteria": [
        "Cosmetic; no impact to functionality",
        "Broken or degraded feature, but a workaround exists",
        "Blocking issue; no workaround exists"
      ],
      "instructions": "How severe is the reported issue?",
      "type": "score"
    }
  },
  "state": "The export button crashes the settings page in Safari. It works in Chrome, but a few of our customers only use Safari."
}

Parameters

ParameterTypeRequiredDescription
modelstringNoWhich model answers first; the others are fallbacks. jev-latest is the Jev version we have tested (the answer names it); jev-preview is the newer Jev release, which its maker labels a preview. microsoft-decision-1 is Microsoft Decision-1, a model-backed judgment, not deterministic. Defaults to jev-… One of: gpt-6-luna, microsoft-decision-1, jev-latest, jev-preview.
questionsobjectYesYour own ids mapped to question objects. Each has type (choice/score/noul), instructions, and criteria for choice/score.
statestring or object or arrayYesThe content to judge. Up to 8000 characters.

Example response

The listing has no example response.

Call it from code

The curl command shows the payment challenge. The JavaScript and Python versions pay and call, and never pay more than $0.001.

curl: see the payment challenge
# bash or zsh: see the payment challenge. Nothing is charged.
curl -sS -g -i -X POST 'https://agent402.tools/v1/judge' \
  -H 'content-type: application/json' \
  --data-raw '{"questions":{"is_reproducible":{"instructions":"Does this report describe steps that would let an engineer reproduce the problem?","type":"noul"},"severity":{"criteria":["Cosmetic; no impact to functionality","Broken or degraded feature, but a workaround exists","Blocking issue; no workaround exists"],"instructions":"How severe is the reported issue?","type":"score"}},"state":"The export button crashes the settings page in Safari. It works in Chrome, but a few of our customers only use Safari."}'

# x402 v2 sends the challenge base64-encoded in the PAYMENT-REQUIRED header (v1 sends it in the body).
# To read the header:
curl -sS -g -o /dev/null -D - -X POST 'https://agent402.tools/v1/judge' \
  -H 'content-type: application/json' \
  --data-raw '{"questions":{"is_reproducible":{"instructions":"Does this report describe steps that would let an engineer reproduce the problem?","type":"noul"},"severity":{"criteria":["Cosmetic; no impact to functionality","Broken or degraded feature, but a workaround exists","Blocking issue; no workaround exists"],"instructions":"How severe is the reported issue?","type":"score"}},"state":"The export button crashes the settings page in Safari. It works in Chrome, but a few of our customers only use Safari."}' \
  | grep -i '^payment-required:' | cut -d' ' -f2 | tr -d '\r' | base64 --decode
JavaScript: pay and call
// npm i @x402/fetch @x402/evm viem
import { wrapFetchWithPayment, x402Client } from "@x402/fetch";
import { registerExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";

// Pays at most $0.001 per call.
const client = new x402Client().setSpendControls({ maxAmountPerPayment: "$0.001" });
registerExactEvmScheme(client, { signer: privateKeyToAccount(process.env.EVM_PRIVATE_KEY) });
const pay = wrapFetchWithPayment(fetch, client);

// Not sure it's safe to pay? ToolVet checks it first for $0.005. Pay for that from a separate
// client: this one is capped at $0.001 per payment. GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Fagent402.tools%2Fv1%2Fjudge&method=POST
const res = await pay("https://agent402.tools/v1/judge", {
  method: "POST",
  headers: { "content-type": "application/json" },
  body: JSON.stringify({
    "questions": {
      "is_reproducible": {
        "instructions": "Does this report describe steps that would let an engineer reproduce the problem?",
        "type": "noul"
      },
      "severity": {
        "criteria": [
          "Cosmetic; no impact to functionality",
          "Broken or degraded feature, but a workaround exists",
          "Blocking issue; no workaround exists"
        ],
        "instructions": "How severe is the reported issue?",
        "type": "score"
      }
    },
    "state": "The export button crashes the settings page in Safari. It works in Chrome, but a few of our customers only use Safari."
  }),
});
console.log(res.status, await res.text());
Python: pay and call
# pip install "x402[requests,evm]"
import os
from eth_account import Account
from x402 import x402ClientSync
from x402.http.clients import x402_requests
from x402.mechanisms.evm import EthAccountSigner
from x402.mechanisms.evm.exact.register import register_exact_evm_client

# Pays at most $0.001 per call.
client = x402ClientSync().set_spend_controls({"max_amount_per_payment": "$0.001"})
register_exact_evm_client(client, EthAccountSigner(Account.from_key(os.environ["EVM_PRIVATE_KEY"])))

with x402_requests(client) as session:
    res = session.post(
        "https://agent402.tools/v1/judge",
        json={
            "questions": {
                "is_reproducible": {
                    "instructions": "Does this report describe steps that would let an engineer reproduce the problem?",
                    "type": "noul",
                },
                "severity": {
                    "criteria": [
                        "Cosmetic; no impact to functionality",
                        "Broken or degraded feature, but a workaround exists",
                        "Blocking issue; no workaround exists",
                    ],
                    "instructions": "How severe is the reported issue?",
                    "type": "score",
                },
            },
            "state": "The export button crashes the settings page in Safari. It works in Chrome, but a few of our customers only use Safari.",
        },
    )
    print(res.status_code, res.text)

Security scan

No findings

We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.

Recent checks

WhenResultHTTPTimePrice
22 min agoPassed402194 ms$0.001
5 h agoPassed402203 ms$0.001
10 h agoPassed402191 ms$0.001
14 h agoPassed402537 ms$0.001
18 h agoPassed402209 ms$0.001
Show 10 older checks
22 h agoPassed402195 ms$0.001
27 h agoPassed402194 ms$0.001
31 h agoPassed402188 ms$0.001
35 h agoPassed402333 ms$0.001
39 h agoPassed402196 ms$0.001
43 h agoPassed402195 ms$0.001
47 h agoPassed402200 ms$0.001
2 days agoPassed402188 ms$0.001
2 days agoPassed402193 ms$0.001
2 days agoPassed402186 ms$0.001