Xcrawl Map

This is a pre-crawl reconnaissance tool that hits XCrawl's Map API to discover URLs across a site before you commit to a full scrape. You give it an entry point, optional regex filters, and limits, and it returns a raw list of discovered links with credit costs. It's built around curl and node with local API key config, no Python required. Useful when you need to estimate scope, validate URL patterns, or cherry-pick sections of a large site instead of crawling blindly. The skill explicitly returns raw API responses by default, which is refreshing if you'd rather handle your own analysis than get an AI summary of what URLs look like.

Install to Claude Code

npx -y skills add xcrawl-api/xcrawl-skills --skill xcrawl-map --agent claude-code