Scrape
by taskfleet.net in Search & web
Scrape any website to clean Markdown, text, or structured JSON. Renders JavaScript/SPA pages with headless Chromium (captures content raw-fetch scrapers miss), handles PDFs, optional schema-driven extraction. Input: { url, format? (markdown|text|html), links? (bool), fields? OR schema? }.
POST https://taskfleet.net/scrape
Last 30 days
Status and outage history · Atom feed
- Uptime
- 100%
- Response time
- 440 ms typical, 2.3 s slowest 5%
- Last check
- 1 h ago
- Next check
- any minute now
How to call it
POST https://taskfleet.net/scrape
Each call costs $0.02 in USDC on Base, paid with the request over x402.
Run a free test callOne unpaid request, the way an agent sends it. You see the payment challenge it gets back. Nothing is charged.
Example request
From the listing.
POST https://taskfleet.net/scrape
content-type: application/json
{
"format": "markdown",
"url": "https://example.com"
}Parameters
| Parameter | Type | Required | Description |
|---|---|---|---|
fields | string | No | Comma-separated fields to extract as JSON |
format | string | No | markdown (default) | text | html |
links | boolean | No | Include extracted links |
schema | object | No | JSON Schema for structured extraction |
url | string | Yes | Public http(s) URL (HTML or PDF) |
Example response
The listing has no example response.
Call it from code
The curl command shows the payment challenge. The JavaScript and Python versions pay and call, and never pay more than $0.02.
curl: see the payment challenge
# bash or zsh: see the payment challenge. Nothing is charged.
curl -sS -g -i -X POST 'https://taskfleet.net/scrape' \
-H 'content-type: application/json' \
--data-raw '{"format":"markdown","url":"https://example.com"}'
# x402 v2 sends the challenge base64-encoded in the PAYMENT-REQUIRED header (v1 sends it in the body).
# To read the header:
curl -sS -g -o /dev/null -D - -X POST 'https://taskfleet.net/scrape' \
-H 'content-type: application/json' \
--data-raw '{"format":"markdown","url":"https://example.com"}' \
| grep -i '^payment-required:' | cut -d' ' -f2 | tr -d '\r' | base64 --decodeJavaScript: pay and call
// npm i @x402/fetch @x402/evm viem
import { wrapFetchWithPayment, x402Client } from "@x402/fetch";
import { registerExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";
// Pays at most $0.02 per call.
const client = new x402Client().setSpendControls({ maxAmountPerPayment: "$0.02" });
registerExactEvmScheme(client, { signer: privateKeyToAccount(process.env.EVM_PRIVATE_KEY) });
const pay = wrapFetchWithPayment(fetch, client);
// Not sure it's safe to pay? ToolVet checks it first for $0.005. Pay for that from a separate
// client: this one is capped at $0.02 per payment. GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Ftaskfleet.net%2Fscrape&method=POST
const res = await pay("https://taskfleet.net/scrape", {
method: "POST",
headers: { "content-type": "application/json" },
body: JSON.stringify({
"format": "markdown",
"url": "https://example.com"
}),
});
console.log(res.status, await res.text());Python: pay and call
# pip install "x402[requests,evm]"
import os
from eth_account import Account
from x402 import x402ClientSync
from x402.http.clients import x402_requests
from x402.mechanisms.evm import EthAccountSigner
from x402.mechanisms.evm.exact.register import register_exact_evm_client
# Pays at most $0.02 per call.
client = x402ClientSync().set_spend_controls({"max_amount_per_payment": "$0.02"})
register_exact_evm_client(client, EthAccountSigner(Account.from_key(os.environ["EVM_PRIVATE_KEY"])))
with x402_requests(client) as session:
res = session.post(
"https://taskfleet.net/scrape",
json={
"format": "markdown",
"url": "https://example.com",
},
)
print(res.status_code, res.text)Security scan
- No findings. We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.
Recent checks
| When | Result | HTTP | Time | Price |
|---|---|---|---|---|
| 1 h ago | Passed | 402 | 404 ms | $0.02 |
| 5 h ago | Passed | 402 | 436 ms | $0.02 |
| 9 h ago | Passed | 402 | 444 ms | $0.02 |
| 13 h ago | Passed | 402 | 448 ms | $0.02 |
| 17 h ago | Passed | 402 | 437 ms | $0.02 |
| 21 h ago | Passed | 402 | 435 ms | $0.02 |
| 25 h ago | Passed | 402 | 437 ms | $0.02 |
| 29 h ago | Passed | 402 | 397 ms | $0.02 |
| 33 h ago | Passed | 402 | 399 ms | $0.02 |
| 36 h ago | Passed | 402 | 389 ms | $0.02 |
| 40 h ago | Passed | 402 | 371 ms | $0.02 |
| 43 h ago | Passed | 402 | 440 ms | $0.02 |
| 47 h ago | Passed | 402 | 1.9 s | $0.02 |
| 2 days ago | Passed | 402 | 1.5 s | $0.02 |
| 2 days ago | Passed | 402 | 494 ms | $0.02 |