
This server wraps Crawlee's crawling engine and embeds a SQLite database to run comprehensive SEO audits locally. It exposes four tools: run_seo_audit to crawl a site with configurable depth and page limits, analyze_seo for automated issue detection, query_seo_data to run custom SQL against 25+ built-in queries covering broken links, missing metadata, duplicate content, and security headers, and list_seo_queries to browse available analysis templates. You can kick off crawls from the terminal for large sites, then hand the output directory to Claude for AI-driven analysis through the MCP tools. Everything runs on your machine with no external API calls. Reach for this when you need technical SEO diagnostics that go deeper than basic checkers, especially if you want to slice crawl data with SQL or automate audits across multiple properties.
This project has been superseded by SEO Audit Console.
SEO Crawler crawled your whole site into SQLite and gave Claude 25+ analysis queries over the result. The crawler survived the move - it was rewritten to be stdio-safe and it is now the crawl half of a bigger tool.
SEO Audit Console keeps the crawl and adds the thing the crawl could never tell you on its own: what people actually searched for to get there. It merges the crawl with your Google Search Console history and on-demand DataForSEO data, then ranks every finding by the clicks it could recover rather than by severity.
A flat crawler sells you severity. This ranks by yield.
git clone https://github.com/houtini-ai/seo-audit.git
Docs and setup: github.com/houtini-ai/seo-audit
@houtini/seo-crawler-mcp is deprecated, not unpublished. Nothing you have running will break.Start a crawl on the new tool and it builds its own database:
start_crawl for https://example.com/
Run refresh_property instead if you want the crawl, the Search Console sync and URL inspection in one pass.
Part of the Houtini open-source MCP set. Questions: hello@houtini.com.
OUTPUT_DIR*Directory where crawl results are saved
DEBUGEnable verbose debug logging (set to 'true' to enable)