Summary
This is a systematic web scraping workflow that starts with a single curl request and only escalates to browser automation when needed. It runs adaptive reconnaissance phases with quality gates, so you're not burning browser resources if the data is already in the raw HTML. The framework detection tables help it recognize Next.js, WordPress, Shopify and others to skip irrelevant patterns. What's smart is the validation phase that actually tests every selector and API endpoint before claiming it works. It includes traffic interception to sniff APIs during page loads and has a full decision tree for when to test anti-bot protections versus when to skip it. Built for Apify Actor development with TypeScript templates included.
Install to Claude Code
npx -y skills add yfe404/web-scraper --skill web-scraping --agent claude-codeInstalls into .claude/skills of the current project.
Plug Mailtrap into your AI workflow and let it handle the email.
Connect Mailtrap MCP →
Agent, run crypto. Access onchain data & trade routes via 1inch.
Install now →
Make coding agent sessions - Searchable, Shareable, Vendor-neutral & Scored.
Try For Free →
Your agent targets a perfect 10 Code Health score. Deterministic. Every commit.
Try For Free →
Integrate web data into your AI product. One API to scrape website & brand data.
Get API Key Now →
belt cli automatically finds the best tools and skills for your agent. image, video, music, tts...
one prompt install →
Files
SKILL.md
Select a file.
Featured
Plug Mailtrap into your AI workflow and let it handle the email.
Connect Mailtrap MCP →Agent, run crypto. Access onchain data & trade routes via 1inch.
Install now →Make coding agent sessions - Searchable, Shareable, Vendor-neutral & Scored.
Try For Free →Your agent targets a perfect 10 Code Health score. Deterministic. Every commit.
Try For Free →Integrate web data into your AI product. One API to scrape website & brand data.
Get API Key Now →belt cli automatically finds the best tools and skills for your agent. image, video, music, tts...
one prompt install →First SeenJun 3, 2026
