Web Search API Eval
OnlineNewWeb search API benchmark for AI agents: You.com, Tavily, Exa, Parallel. Results and charts.
What it can do: 11 tools
get_overall_resultsread-onlyHeadline findings and the overall scorecard across all 30 queries (90 calls per API): accuracy, fully correct, precision@5, freshness, empty responses, failed calls, latency p50/p95, cost per correct answer. Also the perget_scorecardread-onlyFull metric scorecard for one use case (gtm, insurance, finance) or 'overall'. Metrics: search-only latency p50/p95 (server and client), calls under 1 s, accuracy, freshness (% in window, newest relevant result age), concompare_providersread-onlyCompare two or more of You.com, Tavily, Exa and Parallel side by side, overall or within one use case, optionally filtered to metrics whose name contains a keyword (e.g. 'latency', 'accuracy', 'fresh', 'cost', 'empty').recommend_providerread-onlyWhich web search API fits an agent, based on this benchmark: live voice/chat turns, deep research, semantic or long-tail queries, docs lookups, or a specific use case (GTM, insurance, finance). Returns the guidance withlist_questionsread-onlyThe 30 benchmark questions (G1-G10 GTM, I1-I10 insurance, F1-F10 finance): ID, what the agent is asked, the search call and freshness.get_questionread-onlyOne benchmark question by ID (e.g. G3, I4, F5): the task, search call, parameters, answer key with sources, and what each API returned with its accuracy score (0-2, mean of 3 runs).get_chartsread-onlyThe published graphs: overall scorecard, key metrics and per-query grids for GTM, insurance and finance, and developer activation. Without chart_id, lists them with titles and image links; with chart_id, also returns theget_methodologyread-onlyHow the benchmark was run and graded: query design, identical request parameters, 3 runs per query, latency timing, SimpleQA and FreshQA grading, the 10 metrics and the standards they follow, and limits.how_to_run_locallyread-onlyHow to rerun this benchmark on your own machine with your own API keys, including on your own queries. Nothing runs on this server.searchread-onlySearch the Web Search API Eval benchmark (results, questions, methodology, charts, how to run). Returns matching document IDs, titles and URLs.fetchread-onlyFull text of one benchmark document by its ID (for example question-F5, scorecard-finance, overall, methodology).
Connect it
claude mcp add --transport http web-search-api-eval https://websearch-api-eval.psberkeleymba.workers.dev/mcpSettings → Connectors → Add custom connector
URL: https://websearch-api-eval.psberkeleymba.workers.dev/mcp{
"mcpServers": {
"web-search-api-eval": {
"url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
}
}
}{
"servers": {
"web-search-api-eval": {
"type": "http",
"url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
}
}
}Questions
What does Web Search API Eval do?
Web search API benchmark for AI agents: You.com, Tavily, Exa, Parallel. Results and charts. It exposes 11 tools to AI assistants.
What tools does Web Search API Eval provide?
11 tools, including get_overall_results, get_scorecard, compare_providers, recommend_provider, list_questions, get_question, get_charts, get_methodology, how_to_run_locally, search, fetch.
How do I connect Web Search API Eval to Claude, ChatGPT or Cursor?
Add the remote MCP endpoint https://websearch-api-eval.psberkeleymba.workers.dev/mcp as a custom connector or MCP server. Copy-paste setup is on this page.
Does Web Search API Eval require an account or API key?
No sign-in was needed to list its tools. Individual tools may still need an account or API key.
Is Web Search API Eval online?
As of 2026-11-19 our probe found it online. It answered 100% of our last 3 checks.
Who publishes Web Search API Eval?
@psinglap on GitHub. The official MCP Registry verified that the publisher controls this GitHub account before accepting the listing.
Similar in Web Search & Scraping
-
HugeDomains: premium domain names for saleOnlineOfficialPopularNew
Search and price premium aftermarket domain names for sale on HugeDomains.com.
-
OxylabsOnlineOfficialPopular
Fetch and process content from specified URLs & sources using the Oxylabs Web Scraper API.
-
PadletOnline · sign-in requiredOfficialPopular
Read, search, create and edit Padlet boards: posts, sections, comments, settings and sharing.
-
Atom.com — Premium DomainsOnlineOfficialPopular
Search, appraise, trademark-check, and buy premium brandable domain names from Atom.com.
-
Dm Drogerie MarktOnlineOfficialPopular
Real-time product data, semantic search and more from dm-drogerie markt, Europe's leading drugstore.
-
ZolaOnlineOfficialNew
Find US wedding vendors, registry gifts and invitations, and Zola's wedding planning answers.