fetch_url
Pack: web-fetch · Connect: https://pipeworx.io/mcp (see Connect below for a single-pack URL)
No MCP client? Call it directly: GET https://gateway.pipeworx.io/v1/tools/fetch_url for the schema, then POST the same URL with its arguments for the data.
Fetch the exact contents of ONE public web URL live from its origin server and return them verbatim with a SHA-256 hash of the bytes received.
Parameters
| Name | Type | Required | Description |
|---|---|---|---|
url | string | yes | The absolute http(s) URL to fetch, e.g. “https://data.giss.nasa.gov/gistemp/tabledata_v4/GLB.Ts+dSST.csv”. http:// is tried over https first. |
format | string | no | auto (default): text for HTML and PDF, raw for everything else. raw: the body as received. text: readable text extracted from HTML/PDF. |
max_bytes | number | no | Size of the returned window. Default 100000. Maximum 1000000 for text, 512000 for base64 (binary). |
offset | number | no | Where the window starts: a byte offset into the body (raw), or a character offset into the extracted text (text). Use next_offset from the previous call to page. Default 0. |
Example call
Arguments
{
"url": "https://data.giss.nasa.gov/gistemp/tabledata_v4/GLB.Ts+dSST.csv",
"max_bytes": 2000
}
curl
curl -X POST https://gateway.pipeworx.io/web-fetch/mcp \
-H 'Content-Type: application/json' \
-d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"fetch_url","arguments":{"url":"https://data.giss.nasa.gov/gistemp/tabledata_v4/GLB.Ts+dSST.csv","max_bytes":2000}}}'
TypeScript (@pipeworx/sdk)
import { Pipeworx } from '@pipeworx/sdk';
const pipeworx = new Pipeworx();
const result = await pipeworx.call('fetch_url', {
"url": "https://data.giss.nasa.gov/gistemp/tabledata_v4/GLB.Ts+dSST.csv",
"max_bytes": 2000
});
More examples
{
"url": "https://data.nber.org/databases/macrohistory/rectdata/13/m13045.dat",
"format": "raw"
}
{
"url": "https://www.cga.ct.gov/2025/ACT/PA/PDF/2025PA-00155-R00SB-01396-PA.PDF",
"format": "text",
"max_bytes": 4000
}
Connect
Add this to your MCP client config — every tool in the catalog, including this one — or use one-click install buttons:
{
"mcpServers": {
"pipeworx": {
"url": "https://pipeworx.io/mcp"
}
}
}
Connect to just the web-fetch pack
{
"mcpServers": {
"web-fetch": {
"url": "https://gateway.pipeworx.io/web-fetch/mcp"
}
}
}
See Getting Started for client-specific install steps.