Crawlora MCP

Crawlora MCP is a hosted Model Context Protocol server that gives AI clients and agents 733 structured public‑web‑data tools across 30+ categories — search, maps, e‑commerce, social, finance, travel, app stores, media, and reviews — each returning clean, normalized JSON instead of HTML to parse.

Two ways to use it: connect any MCP client to the hosted endpoint (https://mcp.crawlora.net/mcp), or run the small open‑source local server in this repo (npx / Docker, stdio) — both expose the same tools and authenticate with your Crawlora API key. Start free with 2,000 credits/month (no card) at crawlora.net.

Connection

Endpoint	https://mcp.crawlora.net/mcp
Transport	Streamable HTTP
Auth	Authorization: Bearer <CRAWLORA_API_KEY> (preferred) — x-api-key: <key> also accepted
Get a key	https://crawlora.net (free 2,000 credits/mo)
Server card	https://crawlora.net/.well-known/mcp/server-card.json

A missing or invalid API key returns 401.

Connect your client

Crawlora MCP works with any MCP‑capable client. Pick yours below — they all point at the same hosted endpoint (https://mcp.crawlora.net/mcp, Streamable HTTP) and authenticate with your CRAWLORA_API_KEY. Prefer keeping the key in an environment variable over pasting it literally, and never commit it. Ready‑to‑paste files for each client live in examples/.

Claude Code (CLI)

claude mcp add --transport http crawlora https://mcp.crawlora.net/mcp \
  --header "Authorization: Bearer ${CRAWLORA_API_KEY}"

Adds at local scope by default. Use --scope user to make it available in every project, or --scope project to write a shared .mcp.json. Confirm with claude mcp list.

Claude Desktop

Settings → Developer → Edit Config, then add to claude_desktop_config.json:

{
  "mcpServers": {
    "crawlora": {
      "url": "https://mcp.crawlora.net/mcp",
      "transport": "streamable-http",
      "headers": { "Authorization": "Bearer YOUR_CRAWLORA_API_KEY" }
    }
  }
}

Cursor

Project‑local .cursor/mcp.json (or ~/.cursor/mcp.json for all projects):

{
  "mcpServers": {
    "crawlora": {
      "url": "https://mcp.crawlora.net/mcp",
      "headers": { "Authorization": "Bearer ${CRAWLORA_API_KEY}" }
    }
  }
}

Codex CLI

codex mcp add crawlora \
  --url https://mcp.crawlora.net/mcp \
  --bearer-token-env-var CRAWLORA_API_KEY

VS Code (GitHub Copilot)

.vscode/mcp.json (project) or your user mcp.json:

{
  "servers": {
    "crawlora": {
      "type": "http",
      "url": "https://mcp.crawlora.net/mcp",
      "headers": { "Authorization": "Bearer ${env:CRAWLORA_API_KEY}" }
    }
  }
}

Windsurf

~/.codeium/windsurf/mcp_config.json (note the serverUrl key):

{
  "mcpServers": {
    "crawlora": {
      "serverUrl": "https://mcp.crawlora.net/mcp",
      "headers": { "Authorization": "Bearer ${env:CRAWLORA_API_KEY}" }
    }
  }
}

Gemini CLI

~/.gemini/settings.json (note the httpUrl key):

{
  "mcpServers": {
    "crawlora": {
      "httpUrl": "https://mcp.crawlora.net/mcp",
      "headers": { "Authorization": "Bearer YOUR_CRAWLORA_API_KEY" }
    }
  }
}

Cline / Roo Code

Add to cline_mcp_settings.json using the generic remote shape — full walkthrough in llms-install.md:

{
  "mcpServers": {
    "crawlora": {
      "url": "https://mcp.crawlora.net/mcp",
      "transport": "streamable-http",
      "headers": { "Authorization": "Bearer ${CRAWLORA_API_KEY}" }
    }
  }
}

Other clients

Any client that speaks Streamable HTTP can use the generic config in examples/mcp.json. stdio‑only clients (e.g. Zed) should run the local server below and point at its npx command.

Run it locally (open‑source server)

This repo also ships a small stdio MCP server (index.mjs) that exposes the same 733 tools, each wrapping the Crawlora REST API (https://api.crawlora.net/api/v1) with your CRAWLORA_API_KEY. Useful if you'd rather run the server yourself than use the hosted endpoint.

# Node 20+ (no install)
CRAWLORA_API_KEY=your-key npx -y crawlora-mcp

# or from a clone
npm install && CRAWLORA_API_KEY=your-key node index.mjs

# or Docker
docker build -t crawlora-mcp . && docker run -i -e CRAWLORA_API_KEY=your-key crawlora-mcp

Client config (stdio):

{
  "mcpServers": {
    "crawlora": {
      "command": "npx",
      "args": ["-y", "crawlora-mcp"],
      "env": { "CRAWLORA_API_KEY": "your-key" }
    }
  }
}

The tool definitions in tools.json are generated from Crawlora's published API catalog; each carries its real input schema and maps to a single REST endpoint.

What you can call (733 tools / 30+ categories)

Category	Tools	Examples
Finance & company intelligence	143	Yahoo Finance, SEC EDGAR, CoinGecko, Polymarket, Kalshi, Metaculus, PitchBook, TrustMRR, Brand — markets, filings, company data, revenue, and prediction markets
Media & entertainment	162	Spotify, podcasts, JustWatch, IMDb, Rotten Tomatoes, Box Office Mojo, Metacritic, TMDB, Letterboxd, Discogs, Goodreads, anime and manga — music, shows, films, books, ratings, reviews, and charts
Social, video & developer	78	YouTube, TikTok, Instagram, Threads, Reddit, LinkedIn, X, GitHub — search, profiles, relationships, posts, replies, comments, transcripts, and trends
E‑commerce	39	Amazon, eBay, Walmart, Shopify, Shop.app — products, search, sellers, collections, and reviews
Search, web & maps	54	Google, Bing, Brave, Google Trends, Google Maps, Geocoding, Web Scrape — SERPs, suggestions, maps, news, media search, interest over time, and URL-to-markdown
App stores	32	App Store, Google Play, Chrome Web Store — apps and extensions, reviews, rankings, similar items, categories, and datasets
Reviews & companies	21	Trustpilot, Capterra, Product Hunt — business and software reviews, launches, makers, and leaderboards
Travel & real estate	21	Airbnb, TripAdvisor, Zillow, Redfin — listings, calendars, hotels, property data, estimates, and region trends
Data & utility	92	Datasets, Numbeo, SimilarWeb, usage — jobs, companies, financials, browser extensions, journalists, cost of living, apps, games, housing, website intelligence, and account usage
Jobs & hiring	26	Greenhouse, Lever, Ashby, Workday, SmartRecruiters, iCIMS, Eightfold, Workable, Recruitee, Rippling, Personio, Teamtailor, Oracle, and UKG — boards, postings, feeds, and hiring signals
Gaming & collectibles	41	Steam, PlayStation, TCDB — games, packages, reviews, player counts, achievements, releases, trading cards, sets, teams, and people
Sports	24	ESPN, SofaScore — live scores, schedules, standings, teams, players, leagues, and tournaments

Full, always‑current tool list with parameters, response examples, and a live Playground: https://crawlora.net/docs.

Why Crawlora

• Normalized JSON per tool — ship data features, not scraper infrastructure.
• No proxies, browsers, or parsers to maintain.
• Pay on success — credit‑based, billed only on 2xx responses.
• One key, 733 tools — search, commerce, social, gaming, finance, and more behind a single MCP endpoint.

A good alternative to stitching together SerpApi, Firecrawl, ScraperAPI, or ScrapingBee.

Links

• Website: https://crawlora.net/mcp
• Docs & Playground: https://crawlora.net/docs · https://crawlora.net/playground
• Pricing: https://crawlora.net/pricing
• Server card: https://crawlora.net/.well-known/mcp/server-card.json
• Official MCP registry manifest: server.json

License

See LICENSE. The Crawlora MCP service itself is a hosted SaaS governed by the Crawlora terms; this repository contains connection docs and manifests.