scrapingbee_scrape
Pack: scrapingbee · Endpoint: https://gateway.pipeworx.io/scrapingbee/mcp
Fetch and render any web page through ScrapingBee (headless browser + proxy rotation), returning the resulting HTML. Handles JS-heavy sites, geolocation, and ad-blocking. Example: scrapingbee_scrape({ url: “https://example.com”, render_js: true, _apiKey: “your-key” })
Parameters
| Name | Type | Required | Description |
|---|---|---|---|
url | string | yes | Full target URL including protocol, e.g. “https://example.com/page” |
render_js | boolean | no | Execute JavaScript via a headless browser (default true). Set false for faster/cheaper static fetches. |
premium_proxy | boolean | no | Route through residential premium proxies (higher credit cost). Use for hard-to-scrape or geo-blocked sites. |
stealth_proxy | boolean | no | Use the stealth proxy pool for the most heavily protected sites (highest credit cost). |
country_code | string | no | ISO 3166-1 alpha-2 country code for proxy geolocation, e.g. “us”, “de”, “br”. |
wait_for | string | no | CSS/XPath selector to wait for before capturing the page, e.g. “#content” or “.results”. |
block_ads | boolean | no | Block advertisements while rendering (default false). |
_apiKey | string | yes | Your ScrapingBee API key (get one free at scrapingbee.com). |
Example call
Arguments
{
"url": "https://example.com/page",
"render_js": true,
"_apiKey": "your-scrapingbee-api-key"
}
curl
curl -X POST https://gateway.pipeworx.io/scrapingbee/mcp \
-H 'Content-Type: application/json' \
-d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"scrapingbee_scrape","arguments":{"url":"https://example.com/page","render_js":true,"_apiKey":"your-scrapingbee-api-key"}}}'
TypeScript (@pipeworx/sdk)
import { Pipeworx } from '@pipeworx/sdk';
const pipeworx = new Pipeworx();
const result = await pipeworx.call('scrapingbee_scrape', {
"url": "https://example.com/page",
"render_js": true,
"_apiKey": "your-scrapingbee-api-key"
});
More examples
{
"url": "https://news.example.com/article",
"render_js": true,
"premium_proxy": true,
"country_code": "us",
"wait_for": ".article-content",
"block_ads": true,
"_apiKey": "your-scrapingbee-api-key"
}
Connect
Add this to your MCP client config, or use one-click install buttons:
{
"mcpServers": {
"scrapingbee": {
"url": "https://gateway.pipeworx.io/scrapingbee/mcp"
}
}
}
See Getting Started for client-specific install steps.