71trust / 100
Robots Policy Parse Invoke
by SignalHarness x402 Services in Documents & files
x402 APIPassing, checked 4 h ago
Parses robots.txt groups and applies deterministic longest-match allow and disallow semantics.
POST
https://signalharness.ai/api/agent/services/robots_policy_parse/invoke- Price
- $0.005
- per call in USDC
- Uptime
- 100%
- last 30 days
- Response time
- 888 ms
- 1.4 s slowest 5%
- Last check
- Passed
- 4 h ago, next any minute now
Reliability
All checks passedSome failedAll failedNot checked
How to call it
POST https://signalharness.ai/api/agent/services/robots_policy_parse/invoke
Each call costs $0.005 in USDC on Base, paid with the request over x402.
Run a free test callOne unpaid request, the way an agent sends it. You see the payment challenge it gets back. Nothing is charged.
Example request
From the listing.
POST https://signalharness.ai/api/agent/services/robots_policy_parse/invoke
content-type: application/json
{
"text": "User-agent: *\nAllow: /"
}Parameters
| Parameter | Type | Required | Description |
|---|---|---|---|
targetPath | string | No | |
text | string | No | |
url | string | No | |
userAgent | string | No |
Example response
The provider's example. We can't check it without paying.
Example response, 54 lines
{
"artifacts": [],
"executionId": "example-execution",
"receipt": {
"amountAtomic": "5000",
"artifacts": [],
"asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
"endedAtMs": 0,
"executionId": "example-execution",
"latencyMs": 0,
"network": "eip155:8453",
"paymentId": "example-payment",
"receiptId": "example-receipt",
"requestId": "example-request",
"resultSha256": "9f187257ea9c44cac9c39fc35e42f5352601cd2a27c6b8ee4122b8e15d4a2306",
"serviceId": "robots_policy_parse",
"serviceVersion": "1.0.0",
"settlementReference": "0x0000000000000000000000000000000000000000000000000000000000000000",
"startedAtMs": 0,
"status": "succeeded",
"usage": []
},
"replay": false,
"requestId": "example-request",
"result": {
"crawlAllowed": false,
"crawlDelay": 0,
"groups": [
{
"crawlDelay": 0,
"rules": [
{
"directive": "allow",
"path": "example"
}
],
"userAgents": [
"example"
]
}
],
"matchedGroup": [
null
],
"matchedRule": {},
"sitemaps": [
"example"
],
"warnings": [
"Verify the caller-supplied data before relying on this result."
]
},
"status": "succeeded"
}Call it from code
The curl command shows the payment challenge. The JavaScript and Python versions pay and call, and never pay more than $0.005.
curl: see the payment challenge
# bash or zsh: see the payment challenge. Nothing is charged.
curl -sS -g -i -X POST 'https://signalharness.ai/api/agent/services/robots_policy_parse/invoke' \
-H 'content-type: application/json' \
--data-raw '{"text":"User-agent: *\nAllow: /"}'
# x402 v2 sends the challenge base64-encoded in the PAYMENT-REQUIRED header (v1 sends it in the body).
# To read the header:
curl -sS -g -o /dev/null -D - -X POST 'https://signalharness.ai/api/agent/services/robots_policy_parse/invoke' \
-H 'content-type: application/json' \
--data-raw '{"text":"User-agent: *\nAllow: /"}' \
| grep -i '^payment-required:' | cut -d' ' -f2 | tr -d '\r' | base64 --decodeJavaScript: pay and call
// npm i @x402/fetch @x402/evm viem
import { wrapFetchWithPayment, x402Client } from "@x402/fetch";
import { registerExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";
// Pays at most $0.005 per call.
const client = new x402Client().setSpendControls({ maxAmountPerPayment: "$0.005" });
registerExactEvmScheme(client, { signer: privateKeyToAccount(process.env.EVM_PRIVATE_KEY) });
const pay = wrapFetchWithPayment(fetch, client);
// Not sure it's safe to pay? ToolVet checks it first for $0.005. Pay for that from a separate
// client: this one is capped at $0.005 per payment. GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Fsignalharness.ai%2Fapi%2Fagent%2Fservices%2Frobots_policy_parse%2Finvoke&method=POST
const res = await pay("https://signalharness.ai/api/agent/services/robots_policy_parse/invoke", {
method: "POST",
headers: { "content-type": "application/json" },
body: JSON.stringify({
"text": "User-agent: *\nAllow: /"
}),
});
console.log(res.status, await res.text());Python: pay and call
# pip install "x402[requests,evm]"
import os
from eth_account import Account
from x402 import x402ClientSync
from x402.http.clients import x402_requests
from x402.mechanisms.evm import EthAccountSigner
from x402.mechanisms.evm.exact.register import register_exact_evm_client
# Pays at most $0.005 per call.
client = x402ClientSync().set_spend_controls({"max_amount_per_payment": "$0.005"})
register_exact_evm_client(client, EthAccountSigner(Account.from_key(os.environ["EVM_PRIVATE_KEY"])))
with x402_requests(client) as session:
res = session.post(
"https://signalharness.ai/api/agent/services/robots_policy_parse/invoke",
json={
"text": "User-agent: *\nAllow: /",
},
)
print(res.status_code, res.text)Security scan
No findings
We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.
Recent checks
| When | Result | HTTP | Time | Price |
|---|---|---|---|---|
| 4 h ago | Passed | 402 | 1.2 s | $0.005 |
| 8 h ago | Passed | 402 | 649 ms | $0.005 |
| 13 h ago | Passed | 402 | 325 ms | $0.005 |
| 17 h ago | Passed | 402 | 503 ms | $0.005 |
| 21 h ago | Passed | 402 | 896 ms | $0.005 |
Show 10 older checks
| 25 h ago | Passed | 402 | 805 ms | $0.005 |
| 29 h ago | Passed | 402 | 798 ms | $0.005 |
| 33 h ago | Passed | 402 | 496 ms | $0.005 |
| 37 h ago | Passed | 402 | 704 ms | $0.005 |
| 41 h ago | Passed | 402 | 708 ms | $0.005 |
| 45 h ago | Passed | 402 | 914 ms | $0.005 |
| 2 days ago | Passed | 402 | 1.2 s | $0.005 |
| 2 days ago | Passed | 402 | 1.1 s | $0.005 |
| 2 days ago | Passed | 402 | 1.2 s | $0.005 |
| 3 days ago | Passed | 402 | 1.0 s | $0.005 |