NestDaddy

ScrapingBot

io.scrapingbot/scrapingbot · v1.0.0

Public web data for AI agents: scrape any page, plus Google, TikTok, Instagram and Amazon as JSON.

Connect Remote server

Terminal
claude mcp add --transport http scrapingbot https://scrapingbot.io/api/mcp --header "x-api-key: <X_API_KEY>"
~/.cursor/mcp.json
{
  "mcpServers": {
    "scrapingbot": {
      "url": "https://scrapingbot.io/api/mcp",
      "headers": {
        "x-api-key": "<X_API_KEY>"
      }
    }
  }
}
.vscode/mcp.json
{
  "servers": {
    "scrapingbot": {
      "type": "http",
      "url": "https://scrapingbot.io/api/mcp",
      "headers": {
        "x-api-key": "<X_API_KEY>"
      }
    }
  }
}
Claude Desktop
Settings > Connectors > Add custom connector
URL: https://scrapingbot.io/api/mcp

Replace the values in angle brackets with your own. Keys stay on your machine; we never see them.

Tools 23 found in our last check

  • listCapabilities

    List every ScrapingBot tool, the API routes behind them and their parameters. Free.

  • scrapeWebsite

    Fetch any public web page and return its content as markdown (format: "html" for the raw HTML). 1 credit; render_js (pages built with JavaScript) 5; premium_proxy 10; stealth_proxy 75. screenshot: true attaches a screenshot image.

  • extractStructuredData

    Fetch a web page and have AI pull out exactly the fields you want, as JSON. Pass ai_query (plain English, e.g. "title, price and stock") or ai_schema ({"field": "description"}). The page cost plus 5 credits.

  • getScrapeJob

    Look up an earlier scrape by the job_id it returned. Free.

  • pollJobUntilDone

    Wait for a scrape job to finish, then return it. Free.

  • runBrowserScenario

    Open a page in a real browser, run steps such as click, fill, scroll and wait, then return the resulting page as markdown. js_scenario: {"instructions": [{"fill": ["#q", "shoes"]}, {"click": "#go"}, {"wait": 1000}]}. From 5 credits.

  • googleSearch

    Google results as JSON: web (default), images, videos, news, shopping, places or maps (type), for any country (gl) and language (hl). Places and maps results include a cid for googleReviews. 10 credits.

  • googleReviews

    Reviews of a place from Google Maps, by the cid, fid or placeId in a googleSearch places or maps result. sortBy newest, mostRelevant, highestRating or lowestRating; pass nextPageToken for more. 10 credits.

  • instagramUser

    An Instagram profile: bio, follower, following and post counts, links and the numeric user id other tools need. Pass one of username, user_id or url. 5 credits.

  • instagramSearch

    Search Instagram accounts, hashtags, places or posts (search_type), or everything at once (global). 5 credits.

  • instagramMedia

    Instagram content by mode: an account's posts, reels or tagged posts (user_id), one post by shortcode or url, a post's comments, the replies to a comment (comment_id), or an account's active stories (username). 5 credits.

  • instagramFollowers

    List or search an Instagram account's followers or following, by numeric user_id from instagramUser. query searches the whole list; max_id pages. For very large accounts Instagram shows only about 50 recent followers, so use query to find someone. 5 credits.

  • tiktokVideo

    A TikTok video's stats, caption, author, sound and download links, by video URL. 1 credit.

  • tiktokUser

    A TikTok profile by username: bio, counts, verified badge and numeric user id; include_posts returns the latest videos instead. 1 credit.

  • tiktokSearch

    Search TikTok creators (search_type: users) or videos (videos) by keyword. Videos page: for page 2 onward pass the previous response's data.cursor as cursor and its data.searchId as search_id. Users search returns a single page and ignores cursor. 1 credit.

  • tiktokComments

    Comments on a TikTok video (url), or the replies to one comment (comment_id plus the video url or video_id). 1 credit.

  • tiktokFollowers

    A TikTok account's followers or the accounts it follows, by numeric user_id (data.user.id from tiktokUser). Up to 50. 1 credit.

  • amazonSearch

    Search Amazon US products by keyword: title, price, rating, Prime and photo for each. page for more. 10 credits.

  • amazonProduct

    Everything on an Amazon product page by ASIN: price, rating, availability, bullet points, specifications, photos and variations. 10 credits.

  • amazonProducts

    Full details for up to 20 ASINs in one call, the same as amazonProduct for each. 10 credits per product returned; ASINs that fail are free.

  • amazonSuggestions

    The suggestions Amazon shows as a shopper types: useful for keyword research. 10 credits.

  • amazonRankings

    Amazon's Best Sellers or New Releases for a department, in rank order, with price and rating. 10 credits.

  • providerRequest

    Call any Google, Instagram, TikTok or Amazon endpoint by path, for the few the other tools do not cover (listCapabilities lists them). Costs the same as that API.

Headers

NameDescription
x-api-key
Required, secret
Your ScrapingBot API key, from https://scrapingbot.io/dashboard/api-keys (100 free credits on sign-up).

Details

Endpointhttps://scrapingbot.io/api/mcp (Streamable HTTP)
First published3 Oct 2026
Last updated3 Oct 2026
Registry nameio.scrapingbot/scrapingbot

More search and web servers See all

Listing data from the official MCP registry. Status and tools from NestDaddy's daily check. Browse all MCP servers.