Dev Url Reader
by AgentTools in Search & web
Fetch a web page server-side and convert it to clean markdown — headings, links, lists, tables and text, with scripts, styles and boilerplate stripped. The 'reader' pattern agents use to actually understand web pages. SSRF-guarded with redirects re-validated, 10s timeout, 1MB cap. Use this when an agent needs to fetch any page and get clean markdown an LLM can read.
GET https://agentstoolshub.com/api/v1/dev/url-reader
Last 30 days
Status and outage history · Atom feed
- Uptime
- 100%
- Response time
- 163 ms typical, 211 ms slowest 5%
- Last check
- 2 h ago
- Next check
- any minute now
How to call it
GET https://agentstoolshub.com/api/v1/dev/url-reader
Each call costs $0.01 in USDC on Base, paid with the request over x402.
Run a free test callOne unpaid request, the way an agent sends it. You see the payment challenge it gets back. Nothing is charged.
Example request
From the listing.
GET https://agentstoolshub.com/api/v1/dev/url-reader?maxChars=5000&url=https%3A%2F%2Fexample.comParameters
| Parameter | Type | Required | Description |
|---|---|---|---|
maxChars | number | No | Max markdown length |
url | string | Yes | URL |
Example response
The provider's example. We can't check it without paying.
{
"result": {
"answer": "live data — call the API",
"value": null
},
"tool": "url-reader"
}Call it from code
The curl command shows the payment challenge. The JavaScript and Python versions pay and call, and never pay more than $0.01.
curl: see the payment challenge
# bash or zsh: see the payment challenge. Nothing is charged.
curl -sS -g -i 'https://agentstoolshub.com/api/v1/dev/url-reader?maxChars=5000&url=https%3A%2F%2Fexample.com'
# x402 v2 sends the challenge base64-encoded in the PAYMENT-REQUIRED header (v1 sends it in the body).
# To read the header:
curl -sS -g -o /dev/null -D - 'https://agentstoolshub.com/api/v1/dev/url-reader?maxChars=5000&url=https%3A%2F%2Fexample.com' \
| grep -i '^payment-required:' | cut -d' ' -f2 | tr -d '\r' | base64 --decodeJavaScript: pay and call
// npm i @x402/fetch @x402/evm viem
import { wrapFetchWithPayment, x402Client } from "@x402/fetch";
import { registerExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";
// Pays at most $0.01 per call.
const client = new x402Client().setSpendControls({ maxAmountPerPayment: "$0.01" });
registerExactEvmScheme(client, { signer: privateKeyToAccount(process.env.EVM_PRIVATE_KEY) });
const pay = wrapFetchWithPayment(fetch, client);
// Not sure it's safe to pay? ToolVet checks it first for $0.005. Pay for that from a separate
// client: this one is capped at $0.01 per payment. GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Fagentstoolshub.com%2Fapi%2Fv1%2Fdev%2Furl-reader
const res = await pay("https://agentstoolshub.com/api/v1/dev/url-reader?maxChars=5000&url=https%3A%2F%2Fexample.com");
console.log(res.status, await res.text());Python: pay and call
# pip install "x402[requests,evm]"
import os
from eth_account import Account
from x402 import x402ClientSync
from x402.http.clients import x402_requests
from x402.mechanisms.evm import EthAccountSigner
from x402.mechanisms.evm.exact.register import register_exact_evm_client
# Pays at most $0.01 per call.
client = x402ClientSync().set_spend_controls({"max_amount_per_payment": "$0.01"})
register_exact_evm_client(client, EthAccountSigner(Account.from_key(os.environ["EVM_PRIVATE_KEY"])))
with x402_requests(client) as session:
res = session.get("https://agentstoolshub.com/api/v1/dev/url-reader?maxChars=5000&url=https%3A%2F%2Fexample.com")
print(res.status_code, res.text)Security scan
- No findings. We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.
Recent checks
| When | Result | HTTP | Time | Price |
|---|---|---|---|---|
| 2 h ago | Passed | 402 | 172 ms | $0.01 |
| 6 h ago | Passed | 402 | 178 ms | $0.01 |
| 10 h ago | Passed | 402 | 186 ms | $0.01 |
| 14 h ago | Passed | 402 | 269 ms | $0.01 |
| 18 h ago | Passed | 402 | 154 ms | $0.01 |
| 22 h ago | Passed | 402 | 185 ms | $0.01 |
| 26 h ago | Passed | 402 | 192 ms | $0.01 |
| 29 h ago | Passed | 402 | 163 ms | $0.01 |
| 33 h ago | Passed | 402 | 150 ms | $0.01 |
| 37 h ago | Passed | 402 | 211 ms | $0.01 |
| 40 h ago | Passed | 402 | 134 ms | $0.01 |
| 44 h ago | Passed | 402 | 158 ms | $0.01 |
| 47 h ago | Passed | 402 | 157 ms | $0.01 |
| 2 days ago | Passed | 402 | 185 ms | $0.01 |
| 2 days ago | Passed | 402 | 135 ms | $0.01 |