ToolVet
72trust / 100

Extract Url Content

by minifetch.com in Search & web

x402 APIPassing, checked 6 h ago

For JavaScript-rendered pages & pages blocking native Minifetch that obeys robots.txt: fetch thru an external rotating proxy that renders JS in a headless browser & extract the same clean markdown as /extract/url-content, after nav, ads, and scripts are stripped. Optional ?country= (2-letter code) to fetch from a specific country. Not cached. Does not obey robots.txt. Supports GET & POST

GET
https://minifetch.com/api/v1/x402/proxy/render/extract/url-content
Price
$0.004
per call in USDC
Uptime
100%
last 30 days
Response time
612 ms
866 ms slowest 5%
Last check
Passed
6 h ago, next in 16 min

Run a free test callHow to call it

Reliability

All checks passedSome failedAll failedNot checked

Status and outage history · Atom feed · Watch with other listings

How to call it

GET https://minifetch.com/api/v1/x402/proxy/render/extract/url-content

Each call costs $0.004 in USDC on Base, paid with the request over x402.

Run a free test callOne unpaid request, the way an agent sends it. You see the payment challenge it gets back. Nothing is charged.

Example request

From the listing.

GET https://minifetch.com/api/v1/x402/proxy/render/extract/url-content?url=https%3A%2F%2Fwww.weather.com%2Fweather%2Ftoday

Parameters

ParameterTypeRequiredDescription
countrystringNoOptional. 2-letter ISO 3166-1 country code (ex: us, mx, de) to fetch the page from. Omit to let the external proxy choose. An invalid code returns 400.
includeMediaUrlsbooleanNoOptional. If set to true, includes the page's image URLs (url + alt, from img tags) as mediaUrls.
urlstringYesThe target URL from which to extract the content summary.

Example response

The provider's example. We can't check it without paying.

Example response, 29 lines
{
  "queryParameters": {
    "includeMediaUrls": false
  },
  "results": [
    {
      "data": {
        "minifetchCache": {
          "hit": false
        },
        "proxy": {
          "country": null,
          "provider": "webscrapingapi.com",
          "proxyType": "managed",
          "proxyUrl": "https://api.webscrapingapi.com/v2",
          "render": true,
          "robotsTxt": {
            "allowed": null
          },
          "userAgent": "unknown"
        },
        "requestUrl": "",
        "summary": "",
        "url": ""
      }
    }
  ],
  "success": true
}

Call it from code

The curl command shows the payment challenge. The JavaScript and Python versions pay and call, and never pay more than $0.004.

curl: see the payment challenge
# bash or zsh: see the payment challenge. Nothing is charged.
curl -sS -g -i 'https://minifetch.com/api/v1/x402/proxy/render/extract/url-content?url=https%3A%2F%2Fwww.weather.com%2Fweather%2Ftoday'

# x402 v2 sends the challenge base64-encoded in the PAYMENT-REQUIRED header (v1 sends it in the body).
# To read the header:
curl -sS -g -o /dev/null -D - 'https://minifetch.com/api/v1/x402/proxy/render/extract/url-content?url=https%3A%2F%2Fwww.weather.com%2Fweather%2Ftoday' \
  | grep -i '^payment-required:' | cut -d' ' -f2 | tr -d '\r' | base64 --decode
JavaScript: pay and call
// npm i @x402/fetch @x402/evm viem
import { wrapFetchWithPayment, x402Client } from "@x402/fetch";
import { registerExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";

// Pays at most $0.004 per call.
const client = new x402Client().setSpendControls({ maxAmountPerPayment: "$0.004" });
registerExactEvmScheme(client, { signer: privateKeyToAccount(process.env.EVM_PRIVATE_KEY) });
const pay = wrapFetchWithPayment(fetch, client);

// Not sure it's safe to pay? ToolVet checks it first for $0.005. Pay for that from a separate
// client: this one is capped at $0.004 per payment. GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Fminifetch.com%2Fapi%2Fv1%2Fx402%2Fproxy%2Frender%2Fextract%2Furl-content
const res = await pay("https://minifetch.com/api/v1/x402/proxy/render/extract/url-content?url=https%3A%2F%2Fwww.weather.com%2Fweather%2Ftoday");
console.log(res.status, await res.text());
Python: pay and call
# pip install "x402[requests,evm]"
import os
from eth_account import Account
from x402 import x402ClientSync
from x402.http.clients import x402_requests
from x402.mechanisms.evm import EthAccountSigner
from x402.mechanisms.evm.exact.register import register_exact_evm_client

# Pays at most $0.004 per call.
client = x402ClientSync().set_spend_controls({"max_amount_per_payment": "$0.004"})
register_exact_evm_client(client, EthAccountSigner(Account.from_key(os.environ["EVM_PRIVATE_KEY"])))

with x402_requests(client) as session:
    res = session.get("https://minifetch.com/api/v1/x402/proxy/render/extract/url-content?url=https%3A%2F%2Fwww.weather.com%2Fweather%2Ftoday")
    print(res.status_code, res.text)

Security scan

No findings

We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.

Recent checks

WhenResultHTTPTimePrice
6 h agoPassed402612 ms$0.004
16 h agoPassed402568 ms$0.004
25 h agoPassed402182 ms$0.004
35 h agoPassed402628 ms$0.004
44 h agoPassed402646 ms$0.004
Show 1 older checks
2 days agoPassed402866 ms$0.004