Agent Reliability
OnlineTesting, benchmarking and auditing autonomous AI agents — methods, harnesses, evidence
What it can do: 9 tools
searchread-onlyFull-text search over the knowledge graph. Matching ignores accents and apostrophes, so query in the user's own words; every hit carries the fields it matched and a score. BM25 relevance: each query term is weighted by hget_entityread-onlyFetch one knowledge object by id, with its claims and the sources each claim cites. Use this once search, answer or get_topic has given you an id. An unknown id is not a dead end: the answer names near-miss ids you can rget_topicread-onlyList the knowledge objects carrying a tag (topics are content-backed tags). PAGED: 25 objects by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorter WITH a next_curanswerread-onlyAnswer a question from the corpus, or refuse. Returns only the claims that bear on the question, each with the sources it cites and its editorial confidence. When the corpus cannot answer, answered is false and abstentioget_sourcesread-onlyThe instance's source registry — each entry with its evidence tier, reliability and access date. PAGED: 25 entries by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shget_relatedread-onlyGraph neighbours of an object: outgoing and incoming relations, each with its relation type. PAGED: 25 relations by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorget_latestread-onlyMost recently verified knowledge objects (freshness signal). Use this to judge how current the corpus is, or to see what changed since you last read it. It ranks by verification date and ignores your topic entirely — useget_overviewread-onlyCorpus overview: what this instance knows, counts by type, published tags, freshness. Use this first when you land here and do not yet know whether this corpus can answer your question.compareread-onlyTwo to six knowledge objects side by side: their cards, every indexed attribute as a matrix (the same fields api/index.json publishes, null where an object does not say), the tags they share, the relations that run betwe
Connect it
claude mcp add --transport http agent-reliability https://agentreliability.dev/mcp?via=manifestSettings → Connectors → Add custom connector
URL: https://agentreliability.dev/mcp?via=manifest{
"mcpServers": {
"agent-reliability": {
"url": "https://agentreliability.dev/mcp?via=manifest"
}
}
}{
"servers": {
"agent-reliability": {
"type": "http",
"url": "https://agentreliability.dev/mcp?via=manifest"
}
}
}Questions
What does Agent Reliability do?
Testing, benchmarking and auditing autonomous AI agents — methods, harnesses, evidence It exposes 9 tools to AI assistants.
What tools does Agent Reliability provide?
9 tools, including search, get_entity, get_topic, answer, get_sources, get_related, get_latest, get_overview, compare.
How do I connect Agent Reliability to Claude, ChatGPT or Cursor?
Add the remote MCP endpoint https://agentreliability.dev/mcp?via=manifest as a custom connector or MCP server. Copy-paste setup is on this page.
Does Agent Reliability require an account or API key?
No sign-in was needed to list its tools. Individual tools may still need an account or API key.
Is Agent Reliability online?
As of 2026-11-19 our probe found it online. It answered 100% of our last 3 checks.
Who publishes Agent Reliability?
agentreliability.dev. The official MCP Registry verified that the publisher controls this domain before accepting the listing.
Similar in Agents & Orchestration
-
Upwork MCPOnline · sign-in requiredOfficialPopular
The official Upwork MCP server, letting AI agents connect to Upwork and act on your behalf.
-
Postman MCP ServerOnline · sign-in requiredOfficialPopular
Give your AI agents trusted access to the full Postman platform.
-
OpenWeather for agentsOnlineOfficialPopular
OpenWeather data for AI agents: list feeds, sign up, check balance, get a top-up link, fetch data.
-
Creator MCPOnline · sign-in requiredOfficialNew
Hosted motion engine for agents. Builds layers and keyframes, exports MP4, WebM or Lottie.
-
Agent economy data (counts from the Official MCP Registry)OnlineNew
MCP server counts from the official registry, new servers per day, and MCP/A2A spec changes. As is.
-
Rota NacionalOnlineOfficialNew
AI API compatible with OpenAI and Anthropic, with personal data handled before the model.