ToolVet
82trust / 100

Scrape

by Web Page Scraper in Search & web

x402 APIPassing, checked 47 min ago

Fetch any public web page and return clean main content as JSON: title, author, publish date, hostname, excerpt, full text, and word_count. Boilerplate (nav, ads, footers) is stripped. Input: url (public http/https). Use to read articles, docs, or pages and feed clean text to an LLM.

GET https://x402.shizu.me/scrape

Last 30 days

All checks passedSome failedAll failedNot checked
Uptime
100%
Response time
24 ms typical, 24 ms slowest 5%
Last check
47 min ago
Next check
any minute now

How to call it

# See the payment challenge (nothing is charged)
curl -i -X GET "https://x402.shizu.me/scrape?url=https%3A%2F%2Fexample.com"
import { wrapFetchWithPayment } from "@x402/fetch";
import { x402Client } from "@x402/core/client";
import { ExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";

const client = new x402Client().register(
  "eip155:8453",
  new ExactEvmScheme(privateKeyToAccount(process.env.AGENT_KEY)),
);
const pay = wrapFetchWithPayment(fetch, client);

// Not sure it's safe to pay? Preflight it first for $0.005:
// GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Fx402.shizu.me%2Fscrape
const res = await pay("https://x402.shizu.me/scrape?url=https%3A%2F%2Fexample.com");
console.log(await res.json());

Example input

{
  "url": "https://example.com"
}

Example output

{
  "author": null,
  "date": null,
  "hostname": "example.com",
  "text": "Example Domain. This domain is for use in illustrative examples...",
  "title": "Example Domain",
  "url": "https://example.com",
  "word_count": 19
}

Security scan

  • No findings. We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.

Recent checks

WhenResultHTTPTimePrice
47 min agoPassed40224 ms$0.006
4 h agoPassed40276 ms$0.006
9 h agoPassed40213 ms$0.006