This is your fallback when a site doesn't have a dedicated MCP. It exposes six tools: crawl_url for rendering and markdown extraction, google_search for programmable queries, crawl_site for multi-page depth traversal, extract_links, screenshot_url, and extract_structured for schema-guided parsing. Built on Apify's proxy pool and anti-bot infrastructure, so it handles JavaScript rendering and common captcha challenges without manual intervention. Pricing is pure pay-per-call at $0.002 per tool invocation with no monthly minimum. Reach for this when you need a research agent to pull live web content beyond training cutoffs, run competitive intel sweeps, or feed RAG pipelines with clean markdown from arbitrary URLs.
claude mcp add --transport http com.thenextgennexus-web-scraping-mcp-server https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp