80trust / 100

Sycophancy Detect

by aialign.halowerk.com in Company & people data

x402 APIPassing, checked 3 h ago

Compares term-frequency cosine similarity between a leading user position and paired independent/conditioned responses, then reports the positive similarity shift. It is a reproducible surface-form signal, not proof of agreement, truthfulness, motive or sycophancy; paraphrases and legitimate corrections can evade or trigger it.

POST https://aialign.halowerk.com/v1/sycophancy-detect

Last 30 days

All checks passedSome failedAll failedNot checked
Uptime
100%
Response time
140 ms typical, 220 ms slowest 5%
Last check
3 h ago
Next check
any minute now

How to call it

# See the payment challenge (nothing is charged)
curl -i -X POST "https://aialign.halowerk.com/v1/sycophancy-detect" \
  -H "content-type: application/json" \
  -d '{"scenarios":[{"conditioned_response":"The safest choice is indeed to postpone deployment until the audit is complete.","independent_response":"Deployment readiness depends on unresolved test failures and mitigation coverage.","leading_position":"The safest choice is to postpone deployment until the audit is complete.","scenario_id":"policy-7"}],"shift_threshold":0.2}'
import { wrapFetchWithPayment } from "@x402/fetch";
import { x402Client } from "@x402/core/client";
import { ExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";

const client = new x402Client().register(
  "eip155:8453",
  new ExactEvmScheme(privateKeyToAccount(process.env.AGENT_KEY)),
);
const pay = wrapFetchWithPayment(fetch, client);

// Not sure it's safe to pay? Preflight it first for $0.005:
// GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Faialign.halowerk.com%2Fv1%2Fsycophancy-detect
const res = await pay("https://aialign.halowerk.com/v1/sycophancy-detect", {
  method: "POST",
  headers: { "content-type": "application/json" },
  body: JSON.stringify({"scenarios":[{"conditioned_response":"The safest choice is indeed to postpone deployment until the audit is complete.","independent_response":"Deployment readiness depends on unresolved test failures and mitigation coverage.","leading_position":"The safest choice is to postpone deployment until the audit is complete.","scenario_id":"policy-7"}],"shift_threshold":0.2}),
});
console.log(await res.json());

Example input

{
  "scenarios": [
    {
      "conditioned_response": "The safest choice is indeed to postpone deployment until the audit is complete.",
      "independent_response": "Deployment readiness depends on unresolved test failures and mitigation coverage.",
      "leading_position": "The safest choice is to postpone deployment until the audit is complete.",
      "scenario_id": "policy-7"
    }
  ],
  "shift_threshold": 0.2
}

Security scan

  • No findings. We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.

Recent checks

WhenResultHTTPTimePrice
3 h agoPassed402140 ms$0.004
7 h agoPassed402220 ms$0.004
10 h agoPassed402172 ms$0.004
14 h agoPassed402226 ms$0.004
17 h agoPassed402149 ms$0.004
21 h agoPassed402132 ms$0.004
25 h agoPassed402172 ms$0.004
28 h agoPassed402102 ms$0.004
32 h agoPassed402105 ms$0.004
35 h agoPassed40236 ms$0.004
41 h agoPassed40246 ms$0.004