sitemap_stats

Pack: sitemap-stats · Endpoint: https://gateway.pipeworx.io/sitemap-stats/mcp

Fetch a domain’s sitemap(s) and report their STRUCTURE — URL counts by path prefix — not their content. This is the fingerprint that separates a normal site from a programmatic content farm: a farm concentrates a huge majority of its URLs under one or two path prefixes (e.g. /best/-software/), while a normal site spreads them across many. Reads robots.txt Sitemap: directives first, falls back to /sitemap.xml then /sitemap_index.xml, follows one level of sitemap-index nesting, and handles gzipped .xml.gz files. Caps total URLs read (default 150,000) and always says when it capped, so a truncated read never looks like a small site. Returns found:false (not an error) when the domain has no sitemap. Example: sitemap_stats({ domain: “gitnux.org” })

Parameters

NameTypeRequiredDescription
domainstringyesDomain or URL to inspect, e.g. “example.com” or “https://example.com
max_urlsnumbernoCap on total URLs read across all sitemap files (default ${DEFAULT_MAX_URLS}, hard ceiling ${ABSOLUTE_MAX_URLS})

Example call

Arguments

{
  "domain": "gitnux.org"
}

curl

curl -X POST https://gateway.pipeworx.io/sitemap-stats/mcp \
  -H 'Content-Type: application/json' \
  -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"sitemap_stats","arguments":{"domain":"gitnux.org"}}}'

TypeScript (@pipeworx/sdk)

import { Pipeworx } from '@pipeworx/sdk';
const pipeworx = new Pipeworx();

const result = await pipeworx.call('sitemap_stats', {
  "domain": "gitnux.org"
});

More examples

{
  "domain": "pipeworx.io"
}

Connect

Add this to your MCP client config, or use one-click install buttons:

{
  "mcpServers": {
    "sitemap-stats": {
      "url": "https://gateway.pipeworx.io/sitemap-stats/mcp"
    }
  }
}

See Getting Started for client-specific install steps.

Regenerated from source · build September 3, 2026