fetch_url

Pack: web-fetch · Connect: https://pipeworx.io/mcp (see Connect below for a single-pack URL)

No MCP client? Call it directly: GET https://gateway.pipeworx.io/v1/tools/fetch_url for the schema, then POST the same URL with its arguments for the data.

Fetch the exact contents of ONE public web URL live from its origin server and return them verbatim with a SHA-256 hash of the bytes received.

Parameters

NameTypeRequiredDescription
urlstringyesThe absolute http(s) URL to fetch, e.g. “https://data.giss.nasa.gov/gistemp/tabledata_v4/GLB.Ts+dSST.csv”. http:// is tried over https first.
formatstringnoauto (default): text for HTML and PDF, raw for everything else. raw: the body as received. text: readable text extracted from HTML/PDF.
max_bytesnumbernoSize of the returned window. Default 100000. Maximum 1000000 for text, 512000 for base64 (binary).
offsetnumbernoWhere the window starts: a byte offset into the body (raw), or a character offset into the extracted text (text). Use next_offset from the previous call to page. Default 0.

Example call

Arguments

{
  "url": "https://data.giss.nasa.gov/gistemp/tabledata_v4/GLB.Ts+dSST.csv",
  "max_bytes": 2000
}

curl

curl -X POST https://gateway.pipeworx.io/web-fetch/mcp \
  -H 'Content-Type: application/json' \
  -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"fetch_url","arguments":{"url":"https://data.giss.nasa.gov/gistemp/tabledata_v4/GLB.Ts+dSST.csv","max_bytes":2000}}}'

TypeScript (@pipeworx/sdk)

import { Pipeworx } from '@pipeworx/sdk';
const pipeworx = new Pipeworx();

const result = await pipeworx.call('fetch_url', {
  "url": "https://data.giss.nasa.gov/gistemp/tabledata_v4/GLB.Ts+dSST.csv",
  "max_bytes": 2000
});

More examples

{
  "url": "https://data.nber.org/databases/macrohistory/rectdata/13/m13045.dat",
  "format": "raw"
}
{
  "url": "https://www.cga.ct.gov/2025/ACT/PA/PDF/2025PA-00155-R00SB-01396-PA.PDF",
  "format": "text",
  "max_bytes": 4000
}

Connect

Add this to your MCP client config — every tool in the catalog, including this one — or use one-click install buttons:

{
  "mcpServers": {
    "pipeworx": {
      "url": "https://pipeworx.io/mcp"
    }
  }
}
Connect to just the web-fetch pack
{
  "mcpServers": {
    "web-fetch": {
      "url": "https://gateway.pipeworx.io/web-fetch/mcp"
    }
  }
}

See Getting Started for client-specific install steps.

Regenerated from source · build October 8, 2026