`scrapingant_scrape`

Pack: scrapingant · Connect: https://pipeworx.io/mcp (see Connect below for a single-pack URL)

No MCP client? Call it directly: GET https://gateway.pipeworx.io/v1/tools/scrapingant_scrape for the schema, then POST the same URL with its arguments for the data.

Scrape a web page and return its raw HTML via ScrapingAnt (headless-browser rendering + rotating proxies). Handles JS-heavy sites and anti-bot pages. Example: scrapingant_scrape({ url: “https://example.com”, browser: true, _apiKey: “your-key” })

Parameters

Name	Type	Required	Description
`url`	string	yes	The absolute URL of the page to scrape, e.g. “https://example.com/products”
`browser`	boolean	no	Render the page in a headless browser (executes JavaScript). Default true. Set false for a faster raw HTTP fetch of static pages.
`proxy_type`	string	no	Proxy pool to use: “datacenter” (default, cheaper) or “residential” (harder to block).
`proxy_country`	string	no	Two-letter ISO country code for the proxy exit location, e.g. “US”, “GB”, “DE”.
`wait_for_selector`	string	no	CSS selector to wait for before returning (e.g. “.price”). Only applies when browser rendering is on.
`js_snippet`	string	no	Custom JavaScript to run in the page after load (plain JS — this pack base64-encodes it for you). Only applies when browser rendering is on.
`_apiKey`	string	yes	Your ScrapingAnt API key. Sign up free at https://app.scrapingant.com/signup

Example call

Arguments

{
  "url": "https://example.com/products",
  "browser": true,
  "_apiKey": "your-scrapingant-api-key"
}

curl

curl -X POST https://gateway.pipeworx.io/scrapingant/mcp \
  -H 'Content-Type: application/json' \
  -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"scrapingant_scrape","arguments":{"url":"https://example.com/products","browser":true,"_apiKey":"your-scrapingant-api-key"}}}'

TypeScript (@pipeworx/sdk)

import { Pipeworx } from '@pipeworx/sdk';
const pipeworx = new Pipeworx();

const result = await pipeworx.call('scrapingant_scrape', {
  "url": "https://example.com/products",
  "browser": true,
  "_apiKey": "your-scrapingant-api-key"
});

More examples

{
  "url": "https://example.com/dynamic-content",
  "browser": true,
  "proxy_type": "residential",
  "proxy_country": "US",
  "wait_for_selector": ".price",
  "_apiKey": "your-scrapingant-api-key"
}

Connect

Add this to your MCP client config — every tool in the catalog, including this one — or use one-click install buttons:

{
  "mcpServers": {
    "pipeworx": {
      "url": "https://pipeworx.io/mcp"
    }
  }
}

Connect to just the scrapingant pack

{
  "mcpServers": {
    "scrapingant": {
      "url": "https://gateway.pipeworx.io/scrapingant/mcp"
    }
  }
}

See Getting Started for client-specific install steps.

scrapingant_scrape