Summary
A hosted MCP server that turns e-commerce intelligence into tools your AI can call directly. Point it at a subreddit and get a full growth playbook of top contributors, query competitor catalogs by brand or keyword, pull VOC sentiment from Trustpilot or Google Maps, or run Amazon ASIN reviews through sentiment analysis with listing optimization tips. It also exposes Google Shopping merchant-share rankings and on-demand URL scraping. Reach for this when you're building agents that need to understand product landscapes, mine customer feedback, or automate competitive research without stitching together a dozen scrapers. Connects over streamable-http with Bearer token auth.
Fastest browser for AI agents to run web automation tasks, always free.
Download Free life-time →
Notes, actions and memory. Without a meeting bot. First month 100% off.
Download for free →
belt cli automatically finds the best tools and skills for your agent. image, video, music, tts...
one prompt install →
Connect your Claude agent to live crypto prices and trading routes via 1inch
Get the MCP →
Block distracting apps from your iPhone permanently without a 3rd party app. Free and open source.
Block now (100% free) →smart-crawler MCP
E-commerce competitor intelligence, VOC review sentiment, Amazon ASIN analysis, Google Shopping landscape, on-demand URL scraping, and Reddit subreddit growth playbooks — exposed to AI agents as a hosted Model Context Protocol server.
- Endpoint:
https://smartcrawler.io/mcp/(streamable-http) - Auth:
Authorization: Bearer sck_...— generate a key in the smart-crawler console - Registry:
io.github.shulex-voc/smart-crawler
This repository hosts the public MCP manifest for the smart-crawler service. It is the discovery/connection entry point — the service itself is hosted.
Connect
Claude Code
export SMARTCRAWLER_API_KEY=sck_...
claude mcp add --scope user --transport http smart-crawler \
https://smartcrawler.io/mcp/ \
--header "Authorization: Bearer $SMARTCRAWLER_API_KEY"
--scope user makes the server visible in every project. Without it,
claude mcp add defaults to local scope (only the current directory), a common
"I added it but /mcp is empty" pitfall. Verify with claude mcp list or /mcp.
Codex (~/.codex/config.toml)
[mcp_servers.smart-crawler]
url = "https://smartcrawler.io/mcp/"
bearer_token_env_var = "SMARTCRAWLER_API_KEY"
Any MCP client
Point your client at https://smartcrawler.io/mcp/ over streamable-http and send
your API key as a Bearer token. See mcp.json for the full tool list
and server.json for the registry manifest.
Tools (highlights)
| Tool | What it does |
|---|---|
reddit_subreddit_playbook | Full growth playbook for a subreddit's top contributors |
search_competitor_products | Search competitor catalog by brand / country / keyword / price |
get_voc_reviews | Consumer VOC reviews from Trustpilot / Reviews.io / Google Maps |
amazon_voc_report | Amazon ASIN reviews + AI VOC analysis (pain points, listing tips) |
competitor_landscape | Google Shopping merchant-share ranking for a keyword |
scrape_url | One-URL scrape with short-lived agent memory |
query_warehouse | Warehouse-first natural-language query (0 credits) |
Full list in mcp.json.
License
MIT
Featured
Fastest browser for AI agents to run web automation tasks, always free.
Download Free life-time →Notes, actions and memory. Without a meeting bot. First month 100% off.
Download for free →belt cli automatically finds the best tools and skills for your agent. image, video, music, tts...
one prompt install →Connect your Claude agent to live crypto prices and trading routes via 1inch
Get the MCP →Block distracting apps from your iPhone permanently without a 3rd party app. Free and open source.
Block now (100% free) →Categories
Registryactive
TransportHTTP
AuthRequired
UpdatedJun 8, 2026
