Xcrawl Crawl

This is your interface to XCrawl's full-site crawling API. You get async crawl orchestration with depth limits, regex path filtering, and multi-format output (markdown, links, JSON extraction via prompt or schema). It reads your API key from a local config file at ~/.xcrawl/config.json and uses only curl and node for execution, no Python dependencies. The skill returns raw API responses by default, so you handle the data structure yourself. Useful when you need to map an entire documentation site or product catalog before scraping specific pages. XCrawl runs on a credit system with 1000 free credits to start. The workflow is standard: POST to create a crawl job, poll GET until status hits completed, then parse the data array.

Install to Claude Code

npx -y skills add xcrawl-api/xcrawl-skills --skill xcrawl-crawl --agent claude-code