78trust / 100

Sitemap

by Agent Hub in Search & web

x402 APIPassing, checked 3 h ago

List every page on a website: reads robots.txt and all sitemaps (including sitemap indexes), with last-modified dates; falls back to on-page links. Up to 5000 URLs. Also callable as GET with the same fields as query parameters.

GET https://agents.torbrooknews.com/v1/sitemap

Last 30 days

All checks passedSome failedAll failedNot checked

Status and outage history · Atom feed

Uptime
100%
Response time
131 ms typical, 281 ms slowest 5%
Last check
3 h ago
Next check
any minute now

How to call it

GET https://agents.torbrooknews.com/v1/sitemap

Each call costs $0.02 in USDC on Base, paid with the request over x402.

Run a free test callOne unpaid request, the way an agent sends it. You see the payment challenge it gets back. Nothing is charged.

Example request

From the listing.

GET https://agents.torbrooknews.com/v1/sitemap?limit=200&url=https%3A%2F%2Fexample.com

Parameters

ParameterTypeRequiredDescription
limitintegerNo1 to 5000, default 500
urlstringYes

Example response

The provider's example. We can't check it without paying.

{
  "count": 2,
  "method": "sitemap",
  "site": "https://example.com",
  "urls": [
    {
      "lastmod": "2026-10-01",
      "url": "https://example.com/"
    },
    {
      "url": "https://example.com/about"
    }
  ]
}

Call it from code

The curl command shows the payment challenge. The JavaScript and Python versions pay and call, and never pay more than $0.02.

curl: see the payment challenge
# bash or zsh: see the payment challenge. Nothing is charged.
curl -sS -g -i 'https://agents.torbrooknews.com/v1/sitemap?limit=200&url=https%3A%2F%2Fexample.com'

# x402 v2 sends the challenge base64-encoded in the PAYMENT-REQUIRED header (v1 sends it in the body).
# To read the header:
curl -sS -g -o /dev/null -D - 'https://agents.torbrooknews.com/v1/sitemap?limit=200&url=https%3A%2F%2Fexample.com' \
  | grep -i '^payment-required:' | cut -d' ' -f2 | tr -d '\r' | base64 --decode
JavaScript: pay and call
// npm i @x402/fetch @x402/evm viem
import { wrapFetchWithPayment, x402Client } from "@x402/fetch";
import { registerExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";

// Pays at most $0.02 per call.
const client = new x402Client().setSpendControls({ maxAmountPerPayment: "$0.02" });
registerExactEvmScheme(client, { signer: privateKeyToAccount(process.env.EVM_PRIVATE_KEY) });
const pay = wrapFetchWithPayment(fetch, client);

// Not sure it's safe to pay? ToolVet checks it first for $0.005. Pay for that from a separate
// client: this one is capped at $0.02 per payment. GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Fagents.torbrooknews.com%2Fv1%2Fsitemap
const res = await pay("https://agents.torbrooknews.com/v1/sitemap?limit=200&url=https%3A%2F%2Fexample.com");
console.log(res.status, await res.text());
Python: pay and call
# pip install "x402[requests,evm]"
import os
from eth_account import Account
from x402 import x402ClientSync
from x402.http.clients import x402_requests
from x402.mechanisms.evm import EthAccountSigner
from x402.mechanisms.evm.exact.register import register_exact_evm_client

# Pays at most $0.02 per call.
client = x402ClientSync().set_spend_controls({"max_amount_per_payment": "$0.02"})
register_exact_evm_client(client, EthAccountSigner(Account.from_key(os.environ["EVM_PRIVATE_KEY"])))

with x402_requests(client) as session:
    res = session.get("https://agents.torbrooknews.com/v1/sitemap?limit=200&url=https%3A%2F%2Fexample.com")
    print(res.status_code, res.text)

Security scan

  • No findings. We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.

Recent checks

WhenResultHTTPTimePrice
3 h agoPassed4021.3 s$0.02
7 h agoPassed402100 ms$0.02
11 h agoPassed402131 ms$0.02
14 h agoPassed402224 ms$0.02
18 h agoPassed402129 ms$0.02
22 h agoPassed402144 ms$0.02
26 h agoPassed402179 ms$0.02
30 h agoPassed40244 ms$0.02
33 h agoPassed40251 ms$0.02
43 h agoPassed402281 ms$0.02