85trust / 100

Rubrkit

by rubrkit.com in AI models & inference

MCP serverPassing, checked 7 h ago

MCP-native AI evaluation: rubric audits, eval suites, and proof reports for AI/LLM output.

https://www.rubrkit.com/api/v1/mcp

Last 30 days

All checks passedSome failedAll failedNot checked
Uptime
100%
Response time
325 ms typical, 325 ms slowest 5%
Last check
7 h ago
Next check
any minute now

How to call it

Add it to any MCP client that supports remote servers.

{
  "mcpServers": {
    "rubrkit": {
      "type": "http",
      "url": "https://www.rubrkit.com/api/v1/mcp"
    }
  }
}

41 tools

  • rubrkit_search_api_docs

    Search the canonical docs/api Markdown guides and OpenAPI operation summaries.

  • rubrkit_read_api_doc

    Read a docs/api Markdown guide or OpenAPI source by slug, file name, or docs/api path.

  • rubrkit_read_openapi_contract

    Read the canonical docs/api/openapi.yaml contract.

  • rubrkit_create_artifact_bundle

    Create an artifact bundle through /api/v1/artifact-bundles. Requires artifact_bundles:write for API keys.

  • rubrkit_list_artifact_bundles

    List artifact bundles through /api/v1/artifact-bundles. Requires artifact_bundles:read for API keys.

  • rubrkit_read_artifact_bundle

    Read artifact bundle details, files, and file tree. Requires artifact_bundles:read for API keys.

  • rubrkit_delete_artifact_bundle

    Archive an artifact bundle (soft delete) through DELETE /api/v1/artifact-bundles/{artifactBundleId}. The bundle moves to the archived state and can be restored or permanently deleted later. Requires artifact_bundles:write for API keys.

  • rubrkit_hard_delete_artifact_bundle

    Permanently delete an archived artifact bundle and all of its files, versions, and run history through DELETE /api/v1/artifact-bundles/{artifactBundleId}/permanent. This is irreversible and only works on bundles that are already archived. Requires artifact_bundles:write for API k

  • rubrkit_upload_artifact_files

    Upload one or more text files into an artifact bundle. Requires files:write for API keys.

  • rubrkit_list_artifact_files

    List files in an artifact bundle. Requires files:read for API keys.

  • rubrkit_read_artifact_file

    Read the latest file metadata and content. Requires files:read for API keys.

  • rubrkit_update_artifact_file

    Write a new editable version for a file. Requires files:write for API keys.

  • rubrkit_compact_artifact_file

    Shorten a markdown or text prompt without losing instructions. mode standard (default) is a free deterministic pass that saves a new version unless dryRun is true; requires files:write for API keys. mode deep starts an AI compaction job that uses credits, verifies every instructi

  • rubrkit_estimate_deep_compaction

    Estimate the credit cost of a deep compaction of one file before starting it. Requires compactions:run for API keys.

  • rubrkit_apply_deep_compaction

    Save a succeeded deep compaction job's verified result as a new version of the file. Refused if the file changed since the job started. Requires files:write for API keys.

  • rubrkit_start_audit

    Start an async audit job. Audit results are cached per account by a content hash of their inputs; pass force: true to bypass the cache and run a fresh audit (the same as the CLI's --no-cache flag). Requires audits:run for API keys.

  • rubrkit_list_audits

    List persisted audit history. Requires artifact_bundles:read for API keys.

  • rubrkit_read_audit

    Read a single audit run. Requires artifact_bundles:read for API keys.

  • rubrkit_apply_audit_rewrite

    Apply a completed audit's AI rewrite to the bundle files (a new version per changed file). Requires audits:run for API keys.

  • rubrkit_poll_job

    Read async job progress. Requires jobs:read for API keys.

  • rubrkit_list_job_events

    Read append-only job progress events. Requires jobs:read for API keys.

  • rubrkit_list_artifact_bundle_versions

    List bundle-level version events. Requires artifact_bundles:read for API keys.

  • rubrkit_restore_artifact_bundle_version

    Restore files from a prior artifact-bundle version by creating new file versions. Requires artifact_bundles:write and files:write for API keys.

  • rubrkit_list_file_versions

    List immutable versions for a file. Requires files:read for API keys.

  • rubrkit_restore_file_version

    Restore a prior file version by creating a new version. Requires files:write for API keys.

  • rubrkit_run_evals

    Start an async eval run. Requires evals:run for API keys. Set mode: "advanced" with baselineVersionId and candidateVersionId to run a statistically-backed A/B (repeats defaults to 3, max 5).

  • rubrkit_list_evals

    List eval history. Requires artifact_bundles:read for API keys.

  • rubrkit_read_eval

    Read one eval run, including the `stats` statistical verdict on advanced-mode runs (empty for standard runs). Requires artifact_bundles:read for API keys.

  • rubrkit_export_proof_report

    Start an async proof report job with export storage enabled by default. Requires evals:run for API keys.

  • rubrkit_read_proof_report

    Read one proof report. Requires artifact_bundles:read for API keys.

  • rubrkit_list_golden_cases

    List the golden cases for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:read (or artifacts:pull) for API keys.

  • rubrkit_add_golden_case

    Add a golden case (a real edge-case input with a confirmed-correct output) to an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:write for API keys.

  • rubrkit_retire_golden_case

    Retire a golden case via DELETE /api/v1/golden-cases/{goldenCaseId}. Requires artifact_bundles:write for API keys.

  • rubrkit_create_drift_monitor

    Create a drift monitor pinned to a file version via POST /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:write for API keys.

  • rubrkit_list_drift_monitors

    List the drift monitors for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:read (or artifacts:pull) for API keys.

  • rubrkit_read_drift_observations

    List the recorded observations for a drift monitor via /api/v1/drift-monitors/{driftMonitorId}/observations. Requires artifact_bundles:read (or artifacts:pull) for API keys.

  • rubrkit_run_drift_check

    Queue a drift check immediately instead of waiting for the monitor's schedule, via POST /api/v1/drift-monitors/{driftMonitorId}/check. The first check on a new monitor calibrates its baseline. Costs one audit per repeat. Requires artifact_bundles:write for API keys.

  • rubrkit_set_drift_monitor_status

    Pause or resume a drift monitor via PATCH /api/v1/drift-monitors/{driftMonitorId}. Requires artifact_bundles:write for API keys.

  • rubrkit_record_outcome

    Record a production outcome event (input feature, metric, and/or label) for an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/outcomes. Requires artifact_bundles:write for API keys.

  • rubrkit_read_input_drift

    Compare recent production inputs against a prior reference window (population stability index) for an artifact bundle via GET /api/v1/artifact-bundles/{artifactBundleId}/drift/input. Requires artifact_bundles:read (or artifacts:pull) for API keys.

Security scan

  • No findings. We scan names, descriptions and tool definitions for hidden instructions and other prompt-injection patterns.

Recent checks

WhenResultHTTPTime
7 h agoPassed200325 ms
17 h agoPassed200332 ms