Crawlbase
live DeveloperTechnologyWeb scraping through Crawlbase rotating proxies (bring your own token) — fetch any URL as HTML, markdown or JSON, capture screenshots, and run structured scrapers for Amazon, Google SERP, LinkedIn, Instagram and more.
Tools
crawlbase_scrape Scrape any website through Crawlbase rotating residential proxies with server-side anti-bot bypass (Cloudflare, DataDome, hCaptcha solved for you). Returns the page as HTML (default), clean markdown (
No parameters required.
Try it
crawlbase_screenshot Capture a screenshot of a rendered web page via Crawlbase (headless browser + rotating proxies, anti-bot bypass). Returns a stored screenshot_url (JPEG, link expires after about one hour) plus crawl m
No parameters required.
Try it
crawlbase_structured Scrape a page into clean structured JSON using a named Crawlbase scraper — skip HTML parsing entirely. Common scraper names: "amazon-product-details", "amazon-serp", "google-serp", "facebook-page", "f
No parameters required.
Try it
Test with curl
The gateway speaks JSON-RPC 2.0 over HTTP POST. You can test any pack directly from the terminal.
curl -X POST https://gateway.pipeworx.io/crawlbase/mcp \
-H "Content-Type: application/json" \
-d '{"jsonrpc":"2.0","id":1,"method":"tools/list"}' curl -X POST https://gateway.pipeworx.io/crawlbase/mcp \
-H "Content-Type: application/json" \
-d '{"jsonrpc":"2.0","id":2,"method":"tools/call","params":{"name":"crawlbase_scrape","arguments":{}}}' Use with the SDK
Install @pipeworx/sdk to call tools from any TypeScript/Node project.
import { Pipeworx } from '@pipeworx/sdk';
const px = new Pipeworx();
const result = await px.call("crawlbase_scrape", {}); // Or ask in plain English:
const answer = await px.ask("web scraping through crawlbase rotating proxies (bring your own token) — fetch any url as html, markdown or json, capture screenshots, and run structured scrapers for amazon, google serp, linkedin, instagram and more");