ToolVet
82trust / 100

Site Map

by Site map (URL discovery) in Weather & location

x402 APIPassing, checked 45 min ago

Discover a website's URLs in one call: reads robots.txt, its declared sitemap(s) (sitemap indexes and gzipped sitemaps included, /sitemap.xml as the fallback) and the start page's internal links, then returns a same-host, normalized, deduplicated list (up to 500) with an optional substring filter. Hard budgets: at most 6 fetches, 15 seconds, 5 MB. Use it to pick which pages to crawl or extract next.

POST https://agent402.tools/api/site-map

Last 30 days

All checks passedSome failedAll failedNot checked
Uptime
100%
Response time
204 ms typical, 204 ms slowest 5%
Last check
45 min ago
Next check
any minute now

How to call it

# See the payment challenge (nothing is charged)
curl -i -X POST "https://agent402.tools/api/site-map" \
  -H "content-type: application/json" \
  -d '{"limit":50,"url":"https://agent402.tools"}'
import { wrapFetchWithPayment } from "@x402/fetch";
import { x402Client } from "@x402/core/client";
import { ExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";

const client = new x402Client().register(
  "eip155:8453",
  new ExactEvmScheme(privateKeyToAccount(process.env.AGENT_KEY)),
);
const pay = wrapFetchWithPayment(fetch, client);

// Not sure it's safe to pay? Preflight it first for $0.005:
// GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Fagent402.tools%2Fapi%2Fsite-map
const res = await pay("https://agent402.tools/api/site-map", {
  method: "POST",
  headers: { "content-type": "application/json" },
  body: JSON.stringify({"limit":50,"url":"https://agent402.tools"}),
});
console.log(await res.json());

Example input

{
  "limit": 50,
  "url": "https://agent402.tools"
}

Example output

{
  "fetchedAt": "2026-08-22T00:00:00.000Z",
  "fetches": 6,
  "host": "agent402.tools",
  "search": null,
  "sitemapsRead": 4,
  "source": "robots.txt, sitemap(s) and start-page links, fetched live",
  "sources": {
    "links": 78,
    "sitemap": 1028
  },
  "total": 1106,
  "truncated": true,
  "url": "https://agent402.tools/",
  "urls": [
    "https://agent402.tools/",
    "https://agent402.tools/decide",
    "https://agent402.tools/reports",
    "https://agent402.tools/monitors"
  ],
  "warnings": []
}

Security scan

  • No findings. We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.

Recent checks

WhenResultHTTPTimePrice
45 min agoPassed402190 ms$0.005
4 h agoPassed402204 ms$0.005
9 h agoPassed402217 ms$0.005