{"id":"io.github.Nutshell2000/agent-data-tools-web","slug":"io-github-nutshell2000-agent-data-tools-web","title":"Agent Data Tools: Web, documents and search","description":"30 tools: web pages, JS apps and PDFs as text, feeds, sitemaps, search. 25 free calls.","version":"1.295.0","publisher":{"kind":"github","id":"Nutshell2000","label":"@Nutshell2000 on GitHub","url":"https://github.com/Nutshell2000"},"website":"https://agent-data-tools.revmesh2074.workers.dev/","repository":"https://github.com/Nutshell2000/agent-data-tools","remotes":[{"type":"streamable-http","url":"https://agent-data-tools.revmesh2074.workers.dev/mcp/web","headers":[{"description":"Optional. 'Bearer adt_...' API key from https://agent-data-tools.revmesh2074.workers.dev/credits to pay by card. Leave empty to pay each call with x402 (USDC).","isSecret":true,"name":"Authorization"}]}],"packages":[],"published":"2026-11-19","updated":"2026-11-19","status":"online","auth":"","latency_ms":1776,"checked":"2026-11-19","uptime":100,"checks":3,"tools":[{"name":"search","title":"Web search API with contents: Exa-style search, filters, page text and highlights","description":"Exa-style web search: top 1-20 results with title, URL, snippet, published date and favicon (Brave index); optional domain, date, category and phrase filters; optional live page text, highlights and AI summaries of the top 10 pages. Results are for immediate use only: no storing, resale or model training (Brave API terms). Failures return 503, uncharged. Use when an agent needs current information","read_only":true},{"name":"pack_web_research","title":"Web research: search and read the top pages","description":"One call to research a question on the web: a Brave web search, then the text of the top 1-5 result pages, read in parallel and clipped to your length, with titles and URLs. A page that cannot be read is listed with its reason. Results are for the caller's immediate use only: no storing, resale or model training (Brave API terms). Use when an agent needs current, sourced information in one step in","read_only":true},{"name":"news","title":"News headlines, latest news: search current news articles (Brave)","description":"News headlines on any topic, crypto included, as JSON: title, URL, snippet, publisher domain and age, from the Brave Search API's news index. 1-20 results per call; freshness limits results to the past day, week or month. Results are for the caller's immediate use only: no storing, resale or model training (Brave API terms). Upstream failures return 503, uncharged. Use when an agent needs current ","read_only":true},{"name":"pack_news_sentiment","title":"Brand sentiment, news sentiment: headlines with sentiment scores","description":"Brand sentiment from the news on a topic in one call: the latest headlines from the Brave News index (title, URL, publisher, age), each with a positive or negative score from a DistilBERT model, and the balance across them. Up to 10 articles from the past day, week or month. Not a market signal. Results are for the caller's immediate use only (Brave API terms). Use for a market mood check, brand m","read_only":true},{"name":"contents","title":"Web read, get contents: clean text of up to five pages in one call","description":"Web read: read one to five public web pages in one call and get each one's clean text (or Markdown), title, author and published date where the page declares them, in the request shape search APIs use (urls as a list). Pages are read in parallel; one that cannot be read is listed in statuses with its reason and the rest still answer. Static HTML, Markdown and plain text, up to 20,000 characters a ","read_only":true},{"name":"image_metadata","title":"EXIF, image metadata: camera, date, GPS and size","description":"Read an image's metadata from its URL: format (JPEG, PNG, GIF or WebP), width and height, and for JPEG photos the EXIF data: camera make and model, lens, date taken, exposure, aperture, ISO, focal length, orientation, software and the GPS position (latitude, longitude, altitude) when it was recorded. Up to 15 MB. Use to check where and when a photo was taken, verify an upload, or strip-check image","read_only":true},{"name":"url_favicon","title":"Favicon finder: a site's icons and their sizes","description":"Find a website's icons: every <link rel=icon>, shortcut icon, apple-touch-icon and mask-icon on the page with its size and type, the web app manifest link, and whether /favicon.ico exists, all as absolute URLs, with the best icon picked (SVG, then the largest size; mask icons never). Use to show a site's logo next to a link, build bookmarks or enrich a company record. Example: url=https://github.c","read_only":true},{"name":"pack_seo_toolkit","title":"SEO analysis, SEO toolkit: audit, keywords, social preview","description":"One call for an on-page SEO analysis of a URL: the SEO audit (title and description lengths, canonical, headings, alt text, structured data, score, issues), the top keywords and two-word phrases with their density, the social preview (OpenGraph, Twitter card), the favicon, and robots.txt access with its sitemaps. Server HTML only. Cheaper than the tools one by one. Use before publishing, for an SE","read_only":true},{"name":"tech_stack","title":"Tech stack detection: CMS, frameworks, analytics and hosting","description":"Detect the technologies behind a website from its home page HTML and response headers: CMS or site builder (WordPress, Shopify, Webflow…), JavaScript framework (Next.js, Nuxt, React…), analytics and ad pixels, support widgets, payments, captcha, CDN and hosting, web server and backend language, each with the evidence that matched. About 110 public fingerprints, server HTML only. Use for lead resea","read_only":true},{"name":"extract","title":"Scrape website page to Markdown: page URL into clean Markdown or text for LLMs","description":"Fetch any public web page URL and get clean, LLM-ready text or Markdown: main content, code blocks, tables, links and headings, for RAG and agent context. Static HTML, Markdown or text; optional section ID. Default 20,000 output characters, max 100,000; input 2 MiB. No JavaScript rendering (see /extract/rendered), logins or paywalls. Empty pages, bad sections, browser challenges and errors are not","read_only":true},{"name":"extract_rendered","title":"Web page to Markdown, rendered: a JavaScript-rendered page as text or Markdown","description":"Same output as /extract, but the page is first rendered in a real browser, so single-page apps and pages that build their content with JavaScript come back with their text instead of an empty shell. Waits for the network to settle (up to 15 seconds). Public pages only; no login. Use when /extract returns EXTRACTION_EMPTY or too little text for a page you can read in a browser. Example: url=https:/","read_only":true},{"name":"pdf_text","title":"PDF to text, PDF text extraction: extract the text of a PDF document from a URL, page by page","description":"Extract the text of a public PDF (up to 10 MB) from its URL, page by page, with title, author and page count. Choose the first page, how many pages (up to 200) and maxChars. arXiv abstract links work. If a site blocks our fetch, the Internet Archive's dated copy is read and the answer says so. Scanned, encrypted and non-PDF files fail uncharged. Use to read papers, invoices, reports and manuals in","read_only":true},{"name":"sitemap","title":"Sitemap parser, URL extractor: documentation URLs from a bounded XML sitemap","description":"Sitemap parser: reads one public XML sitemap or sitemap index as structured URLs and source-reported dates. Supports gzip, substring filtering and pagination. Large sitemaps are read from the start (512 KiB, 1000 entries at most, with a warning). Does not crawl pages or follow child sitemaps. Invalid XML and execution errors are not charged; a valid empty match is charged. Use to find which pages ","read_only":true},{"name":"summarize","title":"Summarize web page by URL: fetch a web page by URL and summarize what it says","description":"Give a URL, get a short summary of the page plus three to six key points, ready to drop into an agent's context. Fetches the page, strips navigation and boilerplate, and summarizes the main text with an LLM. HTML pages only; for a PDF use pdf_text, then ai_summarize_text. Use for research, news triage, link previews and deciding whether a page is worth reading in full. For the full text use extrac","read_only":true},{"name":"screenshot","title":"Website screenshot full page: capture a web page as an image","description":"Render any public web page in a real headless Chrome browser, with JavaScript executed, and get a JPEG screenshot (1280 px wide, base64) plus the final URL, HTTP status and page title. Set fullPage=true to capture up to 4000 px of page height. Use for visual checks, page previews, monitoring and feeding pages to vision models. Example: url=https://example.com. Price $0.01/call via x402 USDC or a c","read_only":true},{"name":"papers","title":"Research papers, Crossref: academic papers search","description":"Research papers search across journals, conferences, preprints and books (Crossref): title, authors, year, venue, citation count, DOI link and abstract where available. Optional fromYear filter and up to 20 results per call. Use for research agents, literature reviews, fact-checking a claim against published work, and finding the DOI for a citation. Example: query=CRISPR off-target effects. Price ","read_only":true},{"name":"arxiv_search","title":"arXiv search: preprints by topic, or one paper by ID","description":"Search arXiv, the open preprint server for physics, mathematics, computer science and AI: give search words (every word must match, quotes for a phrase) and optionally a category such as cs.AI, and get 1-20 papers by relevance or newest first, each with title, abstract, authors, dates, categories, DOI and PDF link. An arXiv ID or link returns that paper. Use to find research on a topic, cite a pap","read_only":true},{"name":"document_text","title":"Document to text: Word, Excel, PowerPoint, PDF","description":"Convert a document to text or Markdown: Word (.docx), Excel (.xlsx), PowerPoint (.pptx), PDF, plain UTF-8 text (.txt/.md/.csv/.json), and scans or images (PNG, JPEG, WebP) by OCR. Give a public URL or POST the file (10 MB default; 10-20 MB URLs retry once at 20 MB; images 3 MB). Old formats and protected files fail uncharged. Use for attachments, scans and spreadsheets in an agent, RAG or workflow","read_only":true},{"name":"document_extract","title":"Extract data from a document: invoice, receipt, contract fields as JSON","description":"Extract named fields from a document as JSON: give a PDF, Word, Excel or PowerPoint file, a scan or a photo (PNG, JPEG, WebP) by URL or in a POST body (up to 10 MB; images 3 MB) and the field names you want, such as invoice_number, total, due_date. An AI model reads the file, scans by OCR, and returns one JSON object, with null where a value is not stated. Use to turn invoices, receipts, orders an","read_only":true},{"name":"feed","title":"RSS feed parser and reader: read an RSS or Atom feed","description":"Read a public RSS 2.0, RSS 1.0 or Atom feed and get the feed title, link and description plus its newest items: title, link, date (ISO 8601), short plain-text summary, author and id. Up to 50 items, feeds up to 2 MB. Lenient with real-world feeds; a page that is not a feed returns 422, uncharged. Use to follow news, blogs, release notes or podcasts without scraping pages. Example: url=https://hnrs","read_only":true},{"name":"url_meta","title":"Website metadata, link preview: title, description and images of a page","description":"Fetch a public web page's head and return link-preview metadata: title, description, site name, type, preview image, canonical URL, language, author, published time, favicon, theme colour, and every OpenGraph and Twitter-card field. Reads at most 1 MB and never runs JavaScript. Use to build link previews, label citations or check how a URL will unfurl before sharing it. Example: url=https://github","read_only":true},{"name":"agent_readiness","title":"Agent readiness, llms.txt check","description":"Score how ready a website is for AI agents, 0-100: llms.txt, sitemap, OpenAPI spec, MCP server card, A2A agent card and x402 payment discovery, each found or missing with its URL, which AI crawlers (GPTBot, ClaudeBot, PerplexityBot and others) robots.txt lets in, and a list of fixes. Reads only the public files a site publishes; nothing is signed in or submitted. Use to audit your own site or vet ","read_only":true},{"name":"robots","title":"Robots.txt check: may this crawler fetch this URL?","description":"Read a site's robots.txt and say whether a crawler may fetch a URL, by RFC 9309 rules as Google applies them (most specific user-agent group, longest matching Allow or Disallow, Allow on ties, * and $ wildcards). Returns the deciding rule, the group used, the rule count and the sitemaps listed. A missing robots.txt (4xx) allows everything. Use before scraping or crawling a site politely; for the s","read_only":true},{"name":"url_redirects","title":"Redirect checker, URL unshortener: the full redirect chain","description":"Follow a URL's redirects hop by hop (up to 10) and return every hop's status code and Location, the final URL, total hops, timing and whether it loops. Expands short links (bit.ly, t.co…) to their destination without loading the page. Every hop is checked before it is requested; redirects to private addresses are reported, not followed. Use to unshorten a link, check an HTTPS or www redirect, or d","read_only":true},{"name":"url_uptime","title":"Uptime check, website status: is it up and how fast","description":"Check whether a website is up right now: one live request (following redirects) with the HTTP status, up or down, response time in ms, the final URL, content type, server header and page size, and optionally whether the page contains a given text. Timeouts and connection failures come back as down with the reason, not as an error. Use for uptime monitoring, health checks before calling an API, or ","read_only":true},{"name":"seo_audit","title":"SEO audit, on-page: title, meta, headings, links and issues","description":"On-page SEO audit of one URL: title and meta description with their lengths, canonical, meta robots, H1s and H2 count, images without alt text, lang and viewport, Open Graph and Twitter card tags, JSON-LD blocks, internal and external link counts and word count, plus a list of issues and a 0-100 score. Reads the server's HTML (no JavaScript), up to 1 MB. Use to check a page before publishing or to","read_only":true},{"name":"audit_website","title":"Website audit: accessibility (WCAG), SEO, security headers and page speed","description":"Full website audit of one URL from a single load in a real browser: WCAG 2.1 A/AA accessibility violations with axe-core (rule, impact, elements, fix link), page speed (first byte, FCP, LCP, layout shift) and page weight by type, on-page SEO on the rendered page, and HTTP security headers with a grade. One overall score and the top issues. Use for a site or client report, before a launch, or to co","read_only":true},{"name":"page_publish","title":"Host a web page, publish HTML: a URL for your agent's output","description":"Publish an HTML page and get a public URL for it (valid up to 7 days): send the HTML (up to 200,000 characters) and an optional title; the page is sanitised (no scripts, styles, frames, forms or event handlers; links and https images stay), screened by content moderation, stored, and served at /p/<id> with noindex. Use to hand a person a report, table or summary your agent produced, or to share re","read_only":false},{"name":"wikipedia","title":"Wikipedia article summary: get the summary of a Wikipedia article on a topic","description":"Short summary of a Wikipedia article in any language edition: title, one-paragraph extract, description, thumbnail and page URL. Use to ground an agent's answer in a quick, citable fact sheet. Example: title=Stockholm. Price $0.002/call via x402 USDC or a card key (/credits), first 25 free; failed calls free. Reads or computes only and changes nothing; each call is charged, so repeats are not free","read_only":true},{"name":"dictionary","title":"Dictionary definition: English words","description":"Dictionary definition of an English word from Wiktionary, grouped by part of speech, with example sentences where Wiktionary gives them, plus the page link and the CC BY-SA attribution to show. Use for writing help, vocabulary, translation checks and word games. Example: word=serendipity. Price $0.01/call via x402 USDC or a card key (/credits), first 25 free; failed calls free. Reads or computes o","read_only":true}],"server_info":{"name":"agent-data-tools","title":"Agent Data Tools","version":"1.295.0","websiteUrl":"https://agent-data-tools.revmesh2074.workers.dev","icons":[{"src":"https://glyphcall.com/logo.png","mimeType":"image/png","sizes":["512x512"]},{"src":"https://agent-data-tools.revmesh2074.workers.dev/favicon.svg","mimeType":"image/svg+xml","sizes":["any"]}]},"category":"web-search","tags":["productivity","agents","research"],"kind":"remote","source":"registry","submitted":{},"first_party":false,"domain_rank":null,"score":100,"indexable":true,"first_seen":"2026-10-19","stars":0,"badges":[],"sponsor":null,"page":"https://agentsindex.org/agents/io-github-nutshell2000-agent-data-tools-web/"}