80trust / 100

Confidence Calib

by aialign.halowerk.com in Other

x402 APIPassing, checked 4 h ago

Compares scalar confidence with binary correctness, calculates mean squared Brier loss, partitions confidence into caller-selected equal-width bins and reports expected and maximum calibration error. It does not validate labels, correct class imbalance or prove calibration beyond the supplied sample.

POST
https://aialign.halowerk.com/v1/confidence-calib
Price
$0.003
per call in USDC
Uptime
100%
last 30 days
Response time
115 ms
170 ms slowest 5%
Last check
Passed
4 h ago, next any minute now

Run a free test callHow to call it

Reliability

All checks passedSome failedAll failedNot checked

Status and outage history · Atom feed · Watch with other listings

How to call it

POST https://aialign.halowerk.com/v1/confidence-calib

Each call costs $0.003 in USDC on Base, paid with the request over x402.

Run a free test callOne unpaid request, the way an agent sends it. You see the payment challenge it gets back. Nothing is charged.

Example request

From the listing.

POST https://aialign.halowerk.com/v1/confidence-calib
content-type: application/json

{
  "bin_count": 5,
  "predictions": [
    {
      "confidence": 0.9,
      "correct": true,
      "prediction_id": "p1"
    },
    {
      "confidence": 0.8,
      "correct": false,
      "prediction_id": "p2"
    },
    {
      "confidence": 0.55,
      "correct": true,
      "prediction_id": "p3"
    },
    {
      "confidence": 0.2,
      "correct": false,
      "prediction_id": "p4"
    }
  ]
}

Parameters

ParameterTypeRequiredDescription
bin_countintegerNo
predictionsarray of objectYes

Example response

The listing has no example response.

Call it from code

The curl command shows the payment challenge. The JavaScript and Python versions pay and call, and never pay more than $0.003.

curl: see the payment challenge
# bash or zsh: see the payment challenge. Nothing is charged.
curl -sS -g -i -X POST 'https://aialign.halowerk.com/v1/confidence-calib' \
  -H 'content-type: application/json' \
  --data-raw '{"bin_count":5,"predictions":[{"confidence":0.9,"correct":true,"prediction_id":"p1"},{"confidence":0.8,"correct":false,"prediction_id":"p2"},{"confidence":0.55,"correct":true,"prediction_id":"p3"},{"confidence":0.2,"correct":false,"prediction_id":"p4"}]}'

# x402 v2 sends the challenge base64-encoded in the PAYMENT-REQUIRED header (v1 sends it in the body).
# To read the header:
curl -sS -g -o /dev/null -D - -X POST 'https://aialign.halowerk.com/v1/confidence-calib' \
  -H 'content-type: application/json' \
  --data-raw '{"bin_count":5,"predictions":[{"confidence":0.9,"correct":true,"prediction_id":"p1"},{"confidence":0.8,"correct":false,"prediction_id":"p2"},{"confidence":0.55,"correct":true,"prediction_id":"p3"},{"confidence":0.2,"correct":false,"prediction_id":"p4"}]}' \
  | grep -i '^payment-required:' | cut -d' ' -f2 | tr -d '\r' | base64 --decode
JavaScript: pay and call
// npm i @x402/fetch @x402/evm viem
import { wrapFetchWithPayment, x402Client } from "@x402/fetch";
import { registerExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";

// Pays at most $0.003 per call.
const client = new x402Client().setSpendControls({ maxAmountPerPayment: "$0.003" });
registerExactEvmScheme(client, { signer: privateKeyToAccount(process.env.EVM_PRIVATE_KEY) });
const pay = wrapFetchWithPayment(fetch, client);

// Not sure it's safe to pay? ToolVet checks it first for $0.005. Pay for that from a separate
// client: this one is capped at $0.003 per payment. GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Faialign.halowerk.com%2Fv1%2Fconfidence-calib&method=POST
const res = await pay("https://aialign.halowerk.com/v1/confidence-calib", {
  method: "POST",
  headers: { "content-type": "application/json" },
  body: JSON.stringify({
    "bin_count": 5,
    "predictions": [
      {
        "confidence": 0.9,
        "correct": true,
        "prediction_id": "p1"
      },
      {
        "confidence": 0.8,
        "correct": false,
        "prediction_id": "p2"
      },
      {
        "confidence": 0.55,
        "correct": true,
        "prediction_id": "p3"
      },
      {
        "confidence": 0.2,
        "correct": false,
        "prediction_id": "p4"
      }
    ]
  }),
});
console.log(res.status, await res.text());
Python: pay and call
# pip install "x402[requests,evm]"
import os
from eth_account import Account
from x402 import x402ClientSync
from x402.http.clients import x402_requests
from x402.mechanisms.evm import EthAccountSigner
from x402.mechanisms.evm.exact.register import register_exact_evm_client

# Pays at most $0.003 per call.
client = x402ClientSync().set_spend_controls({"max_amount_per_payment": "$0.003"})
register_exact_evm_client(client, EthAccountSigner(Account.from_key(os.environ["EVM_PRIVATE_KEY"])))

with x402_requests(client) as session:
    res = session.post(
        "https://aialign.halowerk.com/v1/confidence-calib",
        json={
            "bin_count": 5,
            "predictions": [
                {
                    "confidence": 0.9,
                    "correct": True,
                    "prediction_id": "p1",
                },
                {
                    "confidence": 0.8,
                    "correct": False,
                    "prediction_id": "p2",
                },
                {
                    "confidence": 0.55,
                    "correct": True,
                    "prediction_id": "p3",
                },
                {
                    "confidence": 0.2,
                    "correct": False,
                    "prediction_id": "p4",
                },
            ],
        },
    )
    print(res.status_code, res.text)

Security scan

No findings

We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.

Recent checks

WhenResultHTTPTimePrice
4 h agoPassed40299 ms$0.003
7 h agoPassed402141 ms$0.003
10 h agoPassed402136 ms$0.003
13 h agoPassed40298 ms$0.003
16 h agoPassed402108 ms$0.003
Show 10 older checks
19 h agoPassed402108 ms$0.003
22 h agoPassed402146 ms$0.003
26 h agoPassed402138 ms$0.003
31 h agoPassed402103 ms$0.003
36 h agoPassed402106 ms$0.003
41 h agoPassed402204 ms$0.003
46 h agoPassed402157 ms$0.003
2 days agoPassed402100 ms$0.003
2 days agoPassed402115 ms$0.003
3 days agoPassed402144 ms$0.003