Agents Index

Spicrawl

Online

Web scraping MCP server: any URL to Markdown or JSON, with JavaScript rendering and batch jobs.

Visit publisherConnectJSON

What it can do: 27 tools

  • spicrawl_scrapeRetrieve a web page and return its content as markdown (default), text, HTML, a JSON envelope, or a printed PDF. Handles the fetch vs. browser decision, charset decoding, and PDF-to-text for you. Optionally extract struc
  • spicrawl_batch_submitSubmit many URLs to be scraped as one asynchronous job, with shared settings applied to every URL. Give EITHER `urls` or `items`, not both (at least one URL, unless `open` is true). Returns the job object (id, status, es
  • spicrawl_batch_list read-onlyList this API key's project's batch jobs, newest first, with status and progress. Returns `{ batches: [...], next_cursor? }`; pass `next_cursor` back as `cursor` for the next page.
  • spicrawl_batch_status read-onlyReturn one batch job with its status and progress (total/completed/succeeded/failed/remaining, credits charged). Poll this after `spicrawl_batch_submit`; once status is `completed`, `failed` or `cancelled`, read `spicraw
  • spicrawl_batch_results read-onlyReturn a page of FINISHED items of a batch job (one record per item: seq, url, external_id, status, error, and content, or a `result_url` API path (GET /v1/batch/{id}/tasks/{seq}/content, same key) for large bodies). Unf
  • spicrawl_batch_task_content read-onlyReturn the full payload one item of a batch job produced, by its `seq` (items are numbered from 0 in submission order). Cheaper than paging results when you need one URL's output. A CONFLICT error means either the item h
  • spicrawl_batch_cancelCancel a batch job: items not yet started are cancelled and will never run; items already finished keep their results; items already running finish first, so the job comes back `cancelling` and moves to `cancelled` when
  • spicrawl_batch_retryRe-queue every FAILED item of a batch job so it runs again (succeeded items are untouched; a job with no failures is returned unchanged). Returns `{ job, items_reset, items_dispatched }`.
  • spicrawl_batch_add_itemsAppend URLs to a batch job that was submitted with `open: true`. Same item vocabulary as `spicrawl_batch_submit` (EITHER `urls` or `items`, not both, plus shared settings for these new items). Fails with CONFLICT if the
  • spicrawl_batch_closeStop an open batch job accepting items, so it completes once its queued work drains. Idempotent (closing a closed job succeeds). Returns the job object.
  • spicrawl_session_createCreate a session: a persistent browser identity (cookie jar, localStorage, a fixed rendering tier and, by default, a sticky exit IP) that survives across scrapes. Use it for multi-step flows — log in, then fetch pages be
  • spicrawl_session_list read-onlyList this API key's project's sessions, newest first. Returns `{ sessions: [...], next_cursor? }`; pass `next_cursor` back as `cursor` for the next page. Never includes the stored credentials.
  • spicrawl_session_get read-onlyReturn one session's metadata: status, `engine` (its rendering tier), proxy/exit, usage count, expiry, lease holder, and a summary of its stored context. Never returns the credentials themselves (use spicrawl_session_con
  • spicrawl_session_context read-onlyReturn the full stored state of a LIVE session — cookies, localStorage and other credentials — plus its fingerprint and domain scores. The `session_context` object can be passed to spicrawl_session_create to clone the se
  • spicrawl_session_releaseEnd a session when you are done with it: frees its exit IP and browser state; it can no longer be used with spicrawl_scrape. Its stored cookies and storage are purged and cannot be recovered; start a new session and log
  • spicrawl_session_deletePermanently delete a session and its stored state, including the record itself (prefer spicrawl_session_release if you only want to stop using it). Idempotent: deleting an already-deleted session succeeds. Refused while
  • spicrawl_usage read-onlyBilling-grade usage for your org over a date window, from the daily rollup (usage_daily), grouped by day, project, engine, feature or key. group_by=key returns per API key (key_id, name, prefix, project_id) counters per
  • spicrawl_usage_summary read-onlyA compact current-period summary of your org's usage (totals as of now, from the daily rollup). No parameters. Use for a quick 'how much have I used so far'; use spicrawl_usage for a windowed breakdown. Requires the `rea
  • spicrawl_usage_reconciliation read-onlyDrift report for ONE day: re-derives usage from that day's request log and compares it with the billed daily rollup, so you can see whether the rollup missed or double-counted anything. Defaults to yesterday (UTC); today
  • spicrawl_requests_list read-onlyRecent API calls in your key's project, newest first, each with project_id, status, engine, http_status, error_code/error_detail, attempts, URL, proxy used, latency spans (queue/engine/upstream/total ms), block detection
  • spicrawl_request_get read-onlyThe full log record of one past API call by its request id. Every response carries its id in the X-Request-Id header (and error bodies carry it too), so this is the tool for debugging a failed or slow scrape: it shows st
  • spicrawl_browser_connect_urlMints a single-use connect URL for Spicrawl's remote browser (GET /v1/browser, a DevTools Protocol (CDP) WebSocket) so YOUR code can drive it with any CDP client, using the URL as the browser WebSocket endpoint. It calls
  • spicrawl_browser_live_viewGets a link a person can open to watch the remote browser your CDP connection is driving, and take control of it: the same tabs, cookies and page. Use it when a page needs a human: a login, a one-time code, a captcha. Se
  • spicrawl_browser_controlReads or changes who drives a connected remote browser: `agent` (your CDP connection) or `human` (a person in its live view, see spicrawl_browser_live_view). `status` reads it: poll it after sending a live-view link, and
  • spicrawl_docs_search read-onlyFull-text search over the Spicrawl documentation (guides, API reference, errors, limits). Use it to look up a parameter name, value or combination for a spicrawl_* tool, or to explain an error a spicrawl_* tool returned:
  • spicrawl_docs_read read-onlyFetches one Spicrawl documentation page as Markdown. `path` may be a page path (`guides/anti-bot`), a docs URL from spicrawl_docs_search (url or md_url), or either with a `#anchor` (the whole page is returned; the anchor
  • spicrawl_docs_index read-onlyThe docs' llms.txt: every Spicrawl documentation page with its title, a one-line description and its Markdown URL. Use it to find the right page when a search does not, or to get an overview of what is documented; read a

Connect it

Claude Code
claude mcp add --transport http spicrawl https://mcp.spicrawl.com/mcp
Claude.ai / ChatGPT
Settings → Connectors → Add custom connector
URL: https://mcp.spicrawl.com/mcp
Cursor (~/.cursor/mcp.json)
{
  "mcpServers": {
    "spicrawl": {
      "url": "https://mcp.spicrawl.com/mcp"
    }
  }
}
VS Code (.vscode/mcp.json)
{
  "servers": {
    "spicrawl": {
      "type": "http",
      "url": "https://mcp.spicrawl.com/mcp"
    }
  }
}

Questions

What does Spicrawl do?

Web scraping MCP server: any URL to Markdown or JSON, with JavaScript rendering and batch jobs. It exposes 27 tools to AI assistants.

What tools does Spicrawl provide?

27 tools, including spicrawl_scrape, spicrawl_batch_submit, spicrawl_batch_list, spicrawl_batch_status, spicrawl_batch_results, spicrawl_batch_task_content, spicrawl_batch_cancel, spicrawl_batch_retry, spicrawl_batch_add_items, spicrawl_batch_close, spicrawl_session_create, spicrawl_session_list….

How do I connect Spicrawl to Claude, ChatGPT or Cursor?

Add the remote MCP endpoint https://mcp.spicrawl.com/mcp as a custom connector or MCP server. Copy-paste setup is on this page.

Does Spicrawl require an account or API key?

No sign-in was needed to list its tools. Individual tools may still need an account or API key.

Is Spicrawl online?

As of 2026-11-19 our probe found it online. It answered 100% of our last 3 checks.

Who publishes Spicrawl?

@OfficialSpicrawl on GitHub. The official MCP Registry verified that the publisher controls this GitHub account before accepting the listing.

Similar in Web Search & Scraping