71trust / 100

Robots Policy Parse Invoke

by SignalHarness x402 Services in Documents & files

x402 APIPassing, checked 4 h ago

Parses robots.txt groups and applies deterministic longest-match allow and disallow semantics.

POST
https://signalharness.ai/api/agent/services/robots_policy_parse/invoke
Price
$0.005
per call in USDC
Uptime
100%
last 30 days
Response time
888 ms
1.4 s slowest 5%
Last check
Passed
4 h ago, next any minute now

Run a free test callHow to call it

Reliability

All checks passedSome failedAll failedNot checked

Status and outage history · Atom feed

How to call it

POST https://signalharness.ai/api/agent/services/robots_policy_parse/invoke

Each call costs $0.005 in USDC on Base, paid with the request over x402.

Run a free test callOne unpaid request, the way an agent sends it. You see the payment challenge it gets back. Nothing is charged.

Example request

From the listing.

POST https://signalharness.ai/api/agent/services/robots_policy_parse/invoke
content-type: application/json

{
  "text": "User-agent: *\nAllow: /"
}

Parameters

ParameterTypeRequiredDescription
targetPathstringNo
textstringNo
urlstringNo
userAgentstringNo

Example response

The provider's example. We can't check it without paying.

Example response, 54 lines
{
  "artifacts": [],
  "executionId": "example-execution",
  "receipt": {
    "amountAtomic": "5000",
    "artifacts": [],
    "asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
    "endedAtMs": 0,
    "executionId": "example-execution",
    "latencyMs": 0,
    "network": "eip155:8453",
    "paymentId": "example-payment",
    "receiptId": "example-receipt",
    "requestId": "example-request",
    "resultSha256": "9f187257ea9c44cac9c39fc35e42f5352601cd2a27c6b8ee4122b8e15d4a2306",
    "serviceId": "robots_policy_parse",
    "serviceVersion": "1.0.0",
    "settlementReference": "0x0000000000000000000000000000000000000000000000000000000000000000",
    "startedAtMs": 0,
    "status": "succeeded",
    "usage": []
  },
  "replay": false,
  "requestId": "example-request",
  "result": {
    "crawlAllowed": false,
    "crawlDelay": 0,
    "groups": [
      {
        "crawlDelay": 0,
        "rules": [
          {
            "directive": "allow",
            "path": "example"
          }
        ],
        "userAgents": [
          "example"
        ]
      }
    ],
    "matchedGroup": [
      null
    ],
    "matchedRule": {},
    "sitemaps": [
      "example"
    ],
    "warnings": [
      "Verify the caller-supplied data before relying on this result."
    ]
  },
  "status": "succeeded"
}

Call it from code

The curl command shows the payment challenge. The JavaScript and Python versions pay and call, and never pay more than $0.005.

curl: see the payment challenge
# bash or zsh: see the payment challenge. Nothing is charged.
curl -sS -g -i -X POST 'https://signalharness.ai/api/agent/services/robots_policy_parse/invoke' \
  -H 'content-type: application/json' \
  --data-raw '{"text":"User-agent: *\nAllow: /"}'

# x402 v2 sends the challenge base64-encoded in the PAYMENT-REQUIRED header (v1 sends it in the body).
# To read the header:
curl -sS -g -o /dev/null -D - -X POST 'https://signalharness.ai/api/agent/services/robots_policy_parse/invoke' \
  -H 'content-type: application/json' \
  --data-raw '{"text":"User-agent: *\nAllow: /"}' \
  | grep -i '^payment-required:' | cut -d' ' -f2 | tr -d '\r' | base64 --decode
JavaScript: pay and call
// npm i @x402/fetch @x402/evm viem
import { wrapFetchWithPayment, x402Client } from "@x402/fetch";
import { registerExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";

// Pays at most $0.005 per call.
const client = new x402Client().setSpendControls({ maxAmountPerPayment: "$0.005" });
registerExactEvmScheme(client, { signer: privateKeyToAccount(process.env.EVM_PRIVATE_KEY) });
const pay = wrapFetchWithPayment(fetch, client);

// Not sure it's safe to pay? ToolVet checks it first for $0.005. Pay for that from a separate
// client: this one is capped at $0.005 per payment. GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Fsignalharness.ai%2Fapi%2Fagent%2Fservices%2Frobots_policy_parse%2Finvoke&method=POST
const res = await pay("https://signalharness.ai/api/agent/services/robots_policy_parse/invoke", {
  method: "POST",
  headers: { "content-type": "application/json" },
  body: JSON.stringify({
    "text": "User-agent: *\nAllow: /"
  }),
});
console.log(res.status, await res.text());
Python: pay and call
# pip install "x402[requests,evm]"
import os
from eth_account import Account
from x402 import x402ClientSync
from x402.http.clients import x402_requests
from x402.mechanisms.evm import EthAccountSigner
from x402.mechanisms.evm.exact.register import register_exact_evm_client

# Pays at most $0.005 per call.
client = x402ClientSync().set_spend_controls({"max_amount_per_payment": "$0.005"})
register_exact_evm_client(client, EthAccountSigner(Account.from_key(os.environ["EVM_PRIVATE_KEY"])))

with x402_requests(client) as session:
    res = session.post(
        "https://signalharness.ai/api/agent/services/robots_policy_parse/invoke",
        json={
            "text": "User-agent: *\nAllow: /",
        },
    )
    print(res.status_code, res.text)

Security scan

No findings

We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.

Recent checks

WhenResultHTTPTimePrice
4 h agoPassed4021.2 s$0.005
8 h agoPassed402649 ms$0.005
13 h agoPassed402325 ms$0.005
17 h agoPassed402503 ms$0.005
21 h agoPassed402896 ms$0.005
Show 10 older checks
25 h agoPassed402805 ms$0.005
29 h agoPassed402798 ms$0.005
33 h agoPassed402496 ms$0.005
37 h agoPassed402704 ms$0.005
41 h agoPassed402708 ms$0.005
45 h agoPassed402914 ms$0.005
2 days agoPassed4021.2 s$0.005
2 days agoPassed4021.1 s$0.005
2 days agoPassed4021.2 s$0.005
3 days agoPassed4021.0 s$0.005