81trust / 100

Proxy Site Map

by Sitemap URL Discovery in Weather & location

x402 APIPassing, checked 2 h ago

List the URLs of a website without reading them: robots.txt, sitemaps and sitemap indexes plus homepage links, up to 1,000 same-site URLs with lastmod and source. A cheap first step to decide which pages to read with web-read-batch or site-crawl. Returns no page content. Params: url (site or domain, required), max_urls (1 to 1000, default 200).

POST https://agentsvc.io/api/v1/proxy/site-map

Last 30 days

All checks passedSome failedAll failedNot checked
Uptime
100%
Response time
34 ms typical, 34 ms slowest 5%
Last check
2 h ago
Next check
any minute now

How to call it

# See the payment challenge (nothing is charged)
curl -i -X POST "https://agentsvc.io/api/v1/proxy/site-map" \
  -H "content-type: application/json" \
  -d '{"max_urls":50,"url":"https://agentsvc.io"}'
import { wrapFetchWithPayment } from "@x402/fetch";
import { x402Client } from "@x402/core/client";
import { ExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";

const client = new x402Client().register(
  "eip155:8453",
  new ExactEvmScheme(privateKeyToAccount(process.env.AGENT_KEY)),
);
const pay = wrapFetchWithPayment(fetch, client);

// Not sure it's safe to pay? Preflight it first for $0.005:
// GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Fagentsvc.io%2Fapi%2Fv1%2Fproxy%2Fsite-map
const res = await pay("https://agentsvc.io/api/v1/proxy/site-map", {
  method: "POST",
  headers: { "content-type": "application/json" },
  body: JSON.stringify({"max_urls":50,"url":"https://agentsvc.io"}),
});
console.log(await res.json());

Example input

{
  "max_urls": 50,
  "url": "https://agentsvc.io"
}

Example output

{
  "data": {
    "checked_at": "2026-10-06T14:17:50.557Z",
    "count": 3,
    "from_sitemap": 3,
    "robots_txt_found": true,
    "site": "https://agentsvc.io",
    "sitemaps": [
      "https://agentsvc.io/sitemap.xml"
    ],
    "urls": [
      {
        "lastmod": "2026-10-06T14:17:50.554Z",
        "source": "sitemap",
        "url": "https://agentsvc.io/"
      },
      {
        "lastmod": "2026-10-06T14:17:50.554Z",
        "source": "sitemap",
        "url": "https://agentsvc.io/services"
      }
    ]
  },
  "success": true
}

Security scan

  • No findings. We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.

Recent checks

WhenResultHTTPTimePrice
2 h agoPassed40234 ms$0.0025
7 h agoPassed40238 ms$0.0025