81trust / 100

Agent Access

by HALOWERK Agent Tools in Other

x402 APIPassing, checked 4 h ago

Wertet robots.txt fuer 23 benannte KI-Agenten aus, mit korrekter Gruppenauswahl und der Regel, dass die laengste passende Anweisung gewinnt. Prueft zusaetzlich X-Robots-Tag, Meta-Angaben, noai, Bezahlschranken-Hinweise, Lizenzverweise, Nutzungsbedingungen und den TDM-Vorbehalt unter /.well-known/tdmrep.json.

POST https://tools.halowerk.com/v1/agent/access

Last 30 days

All checks passedSome failedAll failedNot checked
Uptime
100%
Response time
39 ms typical, 39 ms slowest 5%
Last check
4 h ago
Next check
any minute now

How to call it

# See the payment challenge (nothing is charged)
curl -i -X POST "https://tools.halowerk.com/v1/agent/access" \
  -H "content-type: application/json" \
  -d '{"domain":"nytimes.com","path":"/section/technology"}'
import { wrapFetchWithPayment } from "@x402/fetch";
import { x402Client } from "@x402/core/client";
import { ExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";

const client = new x402Client().register(
  "eip155:8453",
  new ExactEvmScheme(privateKeyToAccount(process.env.AGENT_KEY)),
);
const pay = wrapFetchWithPayment(fetch, client);

// Not sure it's safe to pay? Preflight it first for $0.005:
// GET https://toolvet.app/api/v1/check?url=https%3A%2F%2Ftools.halowerk.com%2Fv1%2Fagent%2Faccess
const res = await pay("https://tools.halowerk.com/v1/agent/access", {
  method: "POST",
  headers: { "content-type": "application/json" },
  body: JSON.stringify({"domain":"nytimes.com","path":"/section/technology"}),
});
console.log(await res.json());

Example input

{
  "domain": "nytimes.com",
  "path": "/section/technology"
}

Example output

{
  "agents": [
    {
      "agent": "GPTBot",
      "allowed": false,
      "crawl_delay": null,
      "matched_group": "exakt",
      "matched_rule": "Disallow: /",
      "operator": "OpenAI",
      "purpose": "training",
      "reason": "Disallow trifft zu"
    },
    {
      "agent": "Googlebot",
      "allowed": true,
      "crawl_delay": null,
      "matched_group": "exakt",
      "matched_rule": null,
      "operator": "Google",
      "purpose": "suche",
      "reason": "keine Regel trifft zu"
    }
  ],
  "allowed_agents": 9,
  "checked_agents": 23,
  "domain": "nytimes.com",
  "note": "robots.txt und Meta-Angaben sind Bitten des Betreibers, kein Vertrag.",
  "page_signals": {
    "license_link": null,
    "meta_robots": [
      {
        "content": "noarchive",
        "name": "robots"
      }
    ],
    "noai": false,
    "noarchive": true,
    "noindex": false,
    "paywall_hint": true,
    "status": 200,
    "terms_links": [
      "https://help.nytimes.com/hc/en-us/articles/115014893428-Terms-of-service"
    ],
    "x_robots_tag": null
  },
  "path": "/section/technology",
  "robots": {
    "groups": 41,
    "note": null,
    "present": true,
    "sitemaps": [
      "https://www.nytimes.com/sitemaps/new/news.xml.gz"
    ],
    "status": 200
  },
  "stance": "training_gesperrt_abruf_erlaubt",
  "tdm_reservation": {
    "present": false,
    "status": 404
  }
}

Security scan

  • No findings. We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.

Recent checks

WhenResultHTTPTimePrice
4 h agoPassed40239 ms$0.004