82trust / 100

Preflight Url Check

by Minifetch Technical SEO API in Weather & location

x402 APIPassing, checked 3 h ago

Cheap robots.txt preflight before you call the Minifetch /extract and /run/seo-page-audit endpoints: returns whether the Minifetch user agent may fetch a target URL (allow/deny) plus its crawl-delay. If blocked or setting a crawl delay read https://minifetch.com/tutorials/unblock-minifetch . Checks the URL as given — does not follow redirects. Supports GET & POST

GET https://minifetch.com/api/v1/x402/preflight/url-check

Last 30 days

All checks passedSome failedAll failedNot checked
Uptime
100%
Response time
600 ms typical, 600 ms slowest 5%
Last check
3 h ago
Next check
any minute now

How to call it

# See the payment challenge (nothing is charged)
curl -i -X GET "https://minifetch.com/api/v1/x402/preflight/url-check?url=https%3A%2F%2Fgithub.com"
import { wrapFetchWithPayment } from "@x402/fetch";
import { x402Client } from "@x402/core/client";
import { ExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";

const client = new x402Client().register(
  "eip155:8453",
  new ExactEvmScheme(privateKeyToAccount(process.env.AGENT_KEY)),
);
const pay = wrapFetchWithPayment(fetch, client);

// Not sure it's safe to pay? Preflight it first for $0.03:
// GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Fminifetch.com%2Fapi%2Fv1%2Fx402%2Fpreflight%2Furl-check
const res = await pay("https://minifetch.com/api/v1/x402/preflight/url-check?url=https%3A%2F%2Fgithub.com");
console.log(await res.json());

Example input

{
  "url": "https://github.com"
}

Example output

{
  "results": [
    {
      "data": {
        "allowed": true,
        "crawlDelay": 1,
        "message": "Access allowed by robots.txt",
        "minifetchCache": {
          "cachedAt": "2026-08-16T18:22:10.000Z",
          "expiresAt": "2026-08-17T18:22:10.000Z",
          "hit": false
        },
        "proxy": {
          "proxyType": "minifetch",
          "userAgent": "minifetch/1.0 (+https://minifetch.com/site-owner-faq)"
        },
        "url": "https://github.com"
      }
    }
  ],
  "success": true
}

Security scan

  • No findings. We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.

Recent checks

WhenResultHTTPTimePrice
3 h agoPassed402600 ms$0.001