Agents Index

ScrapingBot

Online

Public web data for AI agents: scrape any page, plus Google, TikTok, Instagram and Amazon as JSON.

Visit publisherConnectJSON

What it can do: 23 tools

  • listCapabilities read-onlyList every ScrapingBot tool, the API routes behind them and their parameters. Free.
  • scrapeWebsite read-onlyFetch any public web page and return its content as markdown (format: "html" for the raw HTML). 1 credit; render_js (pages built with JavaScript) 5; premium_proxy 10; stealth_proxy 75. screenshot: true attaches a screens
  • extractStructuredData read-onlyFetch a web page and have AI pull out exactly the fields you want, as JSON. Pass ai_query (plain English, e.g. "title, price and stock") or ai_schema ({"field": "description"}). The page cost plus 5 credits.
  • getScrapeJob read-onlyLook up an earlier scrape by the job_id it returned. Free.
  • pollJobUntilDone read-onlyWait for a scrape job to finish, then return it. Free.
  • runBrowserScenario read-onlyOpen a page in a real browser, run steps such as click, fill, scroll and wait, then return the resulting page as markdown. js_scenario: {"instructions": [{"fill": ["#q", "shoes"]}, {"click": "#go"}, {"wait": 1000}]}. Fro
  • googleSearch read-onlyGoogle results as JSON: web (default), images, videos, news, shopping, places or maps (type), for any country (gl) and language (hl). Places and maps results include a cid for googleReviews. 10 credits.
  • googleReviews read-onlyReviews of a place from Google Maps, by the cid, fid or placeId in a googleSearch places or maps result. sortBy newest, mostRelevant, highestRating or lowestRating; pass nextPageToken for more. 10 credits.
  • instagramUser read-onlyAn Instagram profile: bio, follower, following and post counts, links and the numeric user id other tools need. Pass one of username, user_id or url. 5 credits.
  • instagramSearch read-onlySearch Instagram accounts, hashtags, places or posts (search_type), or everything at once (global). 5 credits.
  • instagramMedia read-onlyInstagram content by mode: an account's posts, reels or tagged posts (user_id), one post by shortcode or url, a post's comments, the replies to a comment (comment_id), or an account's active stories (username). 5 credits
  • instagramFollowers read-onlyList or search an Instagram account's followers or following, by numeric user_id from instagramUser. query searches the whole list; max_id pages. For very large accounts Instagram shows only about 50 recent followers, so
  • tiktokVideo read-onlyA TikTok video's stats, caption, author, sound and download links, by video URL. 1 credit.
  • tiktokUser read-onlyA TikTok profile by username: bio, counts, verified badge and numeric user id; include_posts returns the latest videos instead. 1 credit.
  • tiktokSearch read-onlySearch TikTok creators (search_type: users) or videos (videos) by keyword. Videos page: for page 2 onward pass the previous response's data.cursor as cursor and its data.searchId as search_id. Users search returns a sing
  • tiktokComments read-onlyComments on a TikTok video (url), or the replies to one comment (comment_id plus the video url or video_id). 1 credit.
  • tiktokFollowers read-onlyA TikTok account's followers or the accounts it follows, by numeric user_id (data.user.id from tiktokUser). Up to 50. 1 credit.
  • amazonSearch read-onlySearch Amazon US products by keyword: title, price, rating, Prime and photo for each. page for more. 10 credits.
  • amazonProduct read-onlyEverything on an Amazon product page by ASIN: price, rating, availability, bullet points, specifications, photos and variations. 10 credits.
  • amazonProducts read-onlyFull details for up to 20 ASINs in one call, the same as amazonProduct for each. 10 credits per product returned; ASINs that fail are free.
  • amazonSuggestions read-onlyThe suggestions Amazon shows as a shopper types: useful for keyword research. 10 credits.
  • amazonRankings read-onlyAmazon's Best Sellers or New Releases for a department, in rank order, with price and rating. 10 credits.
  • providerRequest read-onlyCall any Google, Instagram, TikTok or Amazon endpoint by path, for the few the other tools do not cover (listCapabilities lists them). Costs the same as that API.

Connect it

Claude Code
claude mcp add --transport http scrapingbot https://scrapingbot.io/api/mcp
Claude.ai / ChatGPT
Settings → Connectors → Add custom connector
URL: https://scrapingbot.io/api/mcp
Cursor (~/.cursor/mcp.json)
{
  "mcpServers": {
    "scrapingbot": {
      "url": "https://scrapingbot.io/api/mcp"
    }
  }
}
VS Code (.vscode/mcp.json)
{
  "servers": {
    "scrapingbot": {
      "type": "http",
      "url": "https://scrapingbot.io/api/mcp"
    }
  }
}

Questions

What does ScrapingBot do?

Public web data for AI agents: scrape any page, plus Google, TikTok, Instagram and Amazon as JSON. It exposes 23 tools to AI assistants.

What tools does ScrapingBot provide?

23 tools, including listCapabilities, scrapeWebsite, extractStructuredData, getScrapeJob, pollJobUntilDone, runBrowserScenario, googleSearch, googleReviews, instagramUser, instagramSearch, instagramMedia, instagramFollowers….

How do I connect ScrapingBot to Claude, ChatGPT or Cursor?

Add the remote MCP endpoint https://scrapingbot.io/api/mcp as a custom connector or MCP server. Copy-paste setup is on this page.

Does ScrapingBot require an account or API key?

No sign-in was needed to list its tools. Individual tools may still need an account or API key.

Is ScrapingBot online?

As of 2026-11-19 our probe found it online. It answered 100% of our last 3 checks.

Who publishes ScrapingBot?

scrapingbot.io. The official MCP Registry verified that the publisher controls this domain before accepting the listing.

Similar in Web Search & Scraping