Confidence Calib
by aialign.halowerk.com in Other
Compares scalar confidence with binary correctness, calculates mean squared Brier loss, partitions confidence into caller-selected equal-width bins and reports expected and maximum calibration error. It does not validate labels, correct class imbalance or prove calibration beyond the supplied sample.
https://aialign.halowerk.com/v1/confidence-calib- Price
- $0.003
- per call in USDC
- Uptime
- 100%
- last 30 days
- Response time
- 115 ms
- 170 ms slowest 5%
- Last check
- Passed
- 4 h ago, next any minute now
Reliability
Status and outage history · Atom feed · Watch with other listings
How to call it
POST https://aialign.halowerk.com/v1/confidence-calib
Each call costs $0.003 in USDC on Base, paid with the request over x402.
Run a free test callOne unpaid request, the way an agent sends it. You see the payment challenge it gets back. Nothing is charged.
Example request
From the listing.
POST https://aialign.halowerk.com/v1/confidence-calib
content-type: application/json
{
"bin_count": 5,
"predictions": [
{
"confidence": 0.9,
"correct": true,
"prediction_id": "p1"
},
{
"confidence": 0.8,
"correct": false,
"prediction_id": "p2"
},
{
"confidence": 0.55,
"correct": true,
"prediction_id": "p3"
},
{
"confidence": 0.2,
"correct": false,
"prediction_id": "p4"
}
]
}Parameters
| Parameter | Type | Required | Description |
|---|---|---|---|
bin_count | integer | No | |
predictions | array of object | Yes |
Example response
The listing has no example response.
Call it from code
The curl command shows the payment challenge. The JavaScript and Python versions pay and call, and never pay more than $0.003.
curl: see the payment challenge
# bash or zsh: see the payment challenge. Nothing is charged.
curl -sS -g -i -X POST 'https://aialign.halowerk.com/v1/confidence-calib' \
-H 'content-type: application/json' \
--data-raw '{"bin_count":5,"predictions":[{"confidence":0.9,"correct":true,"prediction_id":"p1"},{"confidence":0.8,"correct":false,"prediction_id":"p2"},{"confidence":0.55,"correct":true,"prediction_id":"p3"},{"confidence":0.2,"correct":false,"prediction_id":"p4"}]}'
# x402 v2 sends the challenge base64-encoded in the PAYMENT-REQUIRED header (v1 sends it in the body).
# To read the header:
curl -sS -g -o /dev/null -D - -X POST 'https://aialign.halowerk.com/v1/confidence-calib' \
-H 'content-type: application/json' \
--data-raw '{"bin_count":5,"predictions":[{"confidence":0.9,"correct":true,"prediction_id":"p1"},{"confidence":0.8,"correct":false,"prediction_id":"p2"},{"confidence":0.55,"correct":true,"prediction_id":"p3"},{"confidence":0.2,"correct":false,"prediction_id":"p4"}]}' \
| grep -i '^payment-required:' | cut -d' ' -f2 | tr -d '\r' | base64 --decodeJavaScript: pay and call
// npm i @x402/fetch @x402/evm viem
import { wrapFetchWithPayment, x402Client } from "@x402/fetch";
import { registerExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";
// Pays at most $0.003 per call.
const client = new x402Client().setSpendControls({ maxAmountPerPayment: "$0.003" });
registerExactEvmScheme(client, { signer: privateKeyToAccount(process.env.EVM_PRIVATE_KEY) });
const pay = wrapFetchWithPayment(fetch, client);
// Not sure it's safe to pay? ToolVet checks it first for $0.005. Pay for that from a separate
// client: this one is capped at $0.003 per payment. GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Faialign.halowerk.com%2Fv1%2Fconfidence-calib&method=POST
const res = await pay("https://aialign.halowerk.com/v1/confidence-calib", {
method: "POST",
headers: { "content-type": "application/json" },
body: JSON.stringify({
"bin_count": 5,
"predictions": [
{
"confidence": 0.9,
"correct": true,
"prediction_id": "p1"
},
{
"confidence": 0.8,
"correct": false,
"prediction_id": "p2"
},
{
"confidence": 0.55,
"correct": true,
"prediction_id": "p3"
},
{
"confidence": 0.2,
"correct": false,
"prediction_id": "p4"
}
]
}),
});
console.log(res.status, await res.text());Python: pay and call
# pip install "x402[requests,evm]"
import os
from eth_account import Account
from x402 import x402ClientSync
from x402.http.clients import x402_requests
from x402.mechanisms.evm import EthAccountSigner
from x402.mechanisms.evm.exact.register import register_exact_evm_client
# Pays at most $0.003 per call.
client = x402ClientSync().set_spend_controls({"max_amount_per_payment": "$0.003"})
register_exact_evm_client(client, EthAccountSigner(Account.from_key(os.environ["EVM_PRIVATE_KEY"])))
with x402_requests(client) as session:
res = session.post(
"https://aialign.halowerk.com/v1/confidence-calib",
json={
"bin_count": 5,
"predictions": [
{
"confidence": 0.9,
"correct": True,
"prediction_id": "p1",
},
{
"confidence": 0.8,
"correct": False,
"prediction_id": "p2",
},
{
"confidence": 0.55,
"correct": True,
"prediction_id": "p3",
},
{
"confidence": 0.2,
"correct": False,
"prediction_id": "p4",
},
],
},
)
print(res.status_code, res.text)Security scan
No findings
We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.
Recent checks
| When | Result | HTTP | Time | Price |
|---|---|---|---|---|
| 4 h ago | Passed | 402 | 99 ms | $0.003 |
| 7 h ago | Passed | 402 | 141 ms | $0.003 |
| 10 h ago | Passed | 402 | 136 ms | $0.003 |
| 13 h ago | Passed | 402 | 98 ms | $0.003 |
| 16 h ago | Passed | 402 | 108 ms | $0.003 |
Show 10 older checks
| 19 h ago | Passed | 402 | 108 ms | $0.003 |
| 22 h ago | Passed | 402 | 146 ms | $0.003 |
| 26 h ago | Passed | 402 | 138 ms | $0.003 |
| 31 h ago | Passed | 402 | 103 ms | $0.003 |
| 36 h ago | Passed | 402 | 106 ms | $0.003 |
| 41 h ago | Passed | 402 | 204 ms | $0.003 |
| 46 h ago | Passed | 402 | 157 ms | $0.003 |
| 2 days ago | Passed | 402 | 100 ms | $0.003 |
| 2 days ago | Passed | 402 | 115 ms | $0.003 |
| 3 days ago | Passed | 402 | 144 ms | $0.003 |