ToolVet
75trust / 100

Extract Url Links

by minifetch.com in Search & web

x402 APIPassing, checked 15 min ago

For JavaScript-rendered pages & pages blocking native Minifetch that obeys robots.txt: fetch thru external rotating proxy, render JS in headless browser & extract same categorized links as /extract/url-links (internal, external, anchor) with rel attributes, anchor text and summary stats. Optional ?country= (2-letter code) to fetch from a specific country. Not cached. Does not obey robots.txt. Supports GET & POST

POST
https://minifetch.com/api/v1/x402/proxy/render/extract/url-links
Price
$0.004
per call in USDC
Uptime
100%
last 30 days
Response time
548 ms
810 ms slowest 5%
Last check
Passed
15 min ago, next in 13 min

Run a free test callHow to call it

Reliability

All checks passedSome failedAll failedNot checked

Status and outage history · Atom feed · Watch with other listings

How to call it

POST https://minifetch.com/api/v1/x402/proxy/render/extract/url-links

Each call costs $0.004 in USDC on Base, paid with the request over x402.

Run a free test callOne unpaid request, the way an agent sends it. You see the payment challenge it gets back. Nothing is charged.

Example request

From the listing.

POST https://minifetch.com/api/v1/x402/proxy/render/extract/url-links
content-type: application/json

{
  "url": "https://www.anthropic.com"
}

Parameters

ParameterTypeRequiredDescription
countrystringNoOptional. 2-letter ISO 3166-1 country code (ex: de, mx) to fetch from. Invalid code returns 400.
urlstringYesThe target URL from which to extract the links.

Example response

The provider's example. We can't check it without paying. Shortened for display.

Example response, 79 lines
{
  "results": [
    {
      "data": {
        "links": {
          "anchors": [
            {
              "href": "#main",
              "text": "Skip to main content"
            }
          ],
          "external": [
            {
              "href": "http://trust.anthropic.com/",
              "rel": [],
              "text": "Security and compliance"
            }
          ],
          "internal": [
            {
              "href": "https://www.anthropic.com/",
              "rel": [],
              "text": ""
            },
            {
              "href": "https://www.anthropic.com/research",
              "rel": [],
              "text": "Research"
            }
          ],
          "summary": {
            "anchorCount": 4,
            "emptyTextCount": 13,
            "externalCount": 88,
            "imageLinksMissingAltCount": 0,
            "internalCount": 66,
            "nofollowCount": 0,
            "topExternalDomains": [
              {
                "count": 62,
                "domain": "claude.com"
              },
              {
                "count": 9,
                "domain": "claude.ai"
              }
            ],
            "topInternalTargets": [
              {
                "anchorTexts": [],
                "count": 4,
                "url": "https://www.anthropic.com/research"
              }
            ],
            "totalLinks": 154,
            "uniqueExternalDomains": 9
          }
        },
        "minifetchCache": {
          "hit": false
        },
        "proxy": {
          "country": null,
          "provider": "webscrapingapi.com",
          "proxyType": "managed",
          "proxyUrl": "https://api.webscrapingapi.com/v2",
          "render": true,
          "robotsTxt": {
            "allowed": null
          },
          "userAgent": "unknown"
        },
        "requestUrl": "https://anthropic.com",
        "url": "https://www.anthropic.com/"
      }
    }
  ],
  "success": true
}

Call it from code

The curl command shows the payment challenge. The JavaScript and Python versions pay and call, and never pay more than $0.004.

curl: see the payment challenge
# bash or zsh: see the payment challenge. Nothing is charged.
curl -sS -g -i -X POST 'https://minifetch.com/api/v1/x402/proxy/render/extract/url-links' \
  -H 'content-type: application/json' \
  --data-raw '{"url":"https://www.anthropic.com"}'

# x402 v2 sends the challenge base64-encoded in the PAYMENT-REQUIRED header (v1 sends it in the body).
# To read the header:
curl -sS -g -o /dev/null -D - -X POST 'https://minifetch.com/api/v1/x402/proxy/render/extract/url-links' \
  -H 'content-type: application/json' \
  --data-raw '{"url":"https://www.anthropic.com"}' \
  | grep -i '^payment-required:' | cut -d' ' -f2 | tr -d '\r' | base64 --decode
JavaScript: pay and call
// npm i @x402/fetch @x402/evm viem
import { wrapFetchWithPayment, x402Client } from "@x402/fetch";
import { registerExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";

// Pays at most $0.004 per call.
const client = new x402Client().setSpendControls({ maxAmountPerPayment: "$0.004" });
registerExactEvmScheme(client, { signer: privateKeyToAccount(process.env.EVM_PRIVATE_KEY) });
const pay = wrapFetchWithPayment(fetch, client);

// Not sure it's safe to pay? ToolVet checks it first for $0.005. Pay for that from a separate
// client: this one is capped at $0.004 per payment. GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Fminifetch.com%2Fapi%2Fv1%2Fx402%2Fproxy%2Frender%2Fextract%2Furl-links&method=POST
const res = await pay("https://minifetch.com/api/v1/x402/proxy/render/extract/url-links", {
  method: "POST",
  headers: { "content-type": "application/json" },
  body: JSON.stringify({
    "url": "https://www.anthropic.com"
  }),
});
console.log(res.status, await res.text());
Python: pay and call
# pip install "x402[requests,evm]"
import os
from eth_account import Account
from x402 import x402ClientSync
from x402.http.clients import x402_requests
from x402.mechanisms.evm import EthAccountSigner
from x402.mechanisms.evm.exact.register import register_exact_evm_client

# Pays at most $0.004 per call.
client = x402ClientSync().set_spend_controls({"max_amount_per_payment": "$0.004"})
register_exact_evm_client(client, EthAccountSigner(Account.from_key(os.environ["EVM_PRIVATE_KEY"])))

with x402_requests(client) as session:
    res = session.post(
        "https://minifetch.com/api/v1/x402/proxy/render/extract/url-links",
        json={
            "url": "https://www.anthropic.com",
        },
    )
    print(res.status_code, res.text)

Security scan

No findings

We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.

Recent checks

WhenResultHTTPTimePrice
15 min agoPassed402548 ms$0.004
5 h agoPassed402179 ms$0.004
9 h agoPassed402547 ms$0.004
13 h agoPassed402552 ms$0.004
17 h agoPassed402720 ms$0.004
Show 7 older checks
21 h agoPassed402619 ms$0.004
26 h agoPassed402543 ms$0.004
30 h agoPassed402612 ms$0.004
34 h agoPassed402537 ms$0.004
38 h agoPassed402612 ms$0.004
42 h agoPassed402180 ms$0.004
46 h agoPassed402810 ms$0.004