Crawlgraph

liveTechnologyDeveloper

CrawlGraph — backlink intelligence and competitor gap analysis built on the Common Crawl 4.4B-edge public webgraph.

6tools
0msauth
free tier50 calls/day

Tools

crawlgraph_gap_analysis

Backlink gap analysis: find domains linking to your competitors but NOT to you. Submit your domain + 1–5 competitor domains and CrawlGraph runs an async job (typically completes in seconds; longer for

No parameters required.

▶Try it
crawlgraph_gap_outreach_targets

The warm-outreach play: gap_analysis filtered to ONLY the linking domains that link to EVERY competitor you listed but not to you. These are the highest-conviction outreach candidates — every competit

No parameters required.

▶Try it
crawlgraph_gap_status

Poll a previously-submitted gap analysis job by ID. Use this when crawlgraph_gap_analysis or crawlgraph_gap_outreach_targets returned status=pending with a job_id — call this with the same job_id to r

No parameters required.

▶Try it
crawlgraph_releases

List the Common Crawl releases CrawlGraph has indexed (used as release_id in backlinks). Free; not counted against quota.

No parameters required.

▶Try it
crawlgraph_domain_changes

Quarter-over-quarter diff of referring domains for a domain — what was added or lost between two Common Crawl releases. Useful for catching link rot, sudden spikes (PR coverage), and outreach campaign

No parameters required.

▶Try it

Test with curl

The gateway speaks JSON-RPC 2.0 over HTTP POST. You can test any pack directly from the terminal.

List available tools
bash
curl -X POST https://gateway.pipeworx.io/crawlgraph/mcp \
  -H "Content-Type: application/json" \
  -d '{"jsonrpc":"2.0","id":1,"method":"tools/list"}'
Call a tool
bash
curl -X POST https://gateway.pipeworx.io/crawlgraph/mcp \
  -H "Content-Type: application/json" \
  -d '{"jsonrpc":"2.0","id":2,"method":"tools/call","params":{"name":"crawlgraph_backlinks","arguments":{}}}'

Use with the SDK

Install @pipeworx/sdk to call tools from any TypeScript/Node project.

TypeScript
import { Pipeworx } from '@pipeworx/sdk';
const px = new Pipeworx();
const result = await px.call("crawlgraph_backlinks", {});
ask_pipeworx
// Or ask in plain English:
const answer = await px.ask("crawlgraph — backlink intelligence and competitor gap analysis built on the common crawl 4");