A straightforward Python scraper that saves web pages as HTML or Markdown with downloaded images, no browser automation required. Just requests and BeautifulSoup4. Single page mode is fast for archiving articles or documentation. Recursive mode follows links with sensible guardrails: depth limits, rate limiting, robots.txt compliance by default. Images get saved to a local folder automatically, which is nice for offline viewing. The recursive crawling is sequential rather than parallel, so it's polite but not blazing fast. Good for documentation snapshots or building local archives when you need actual files on disk, not just viewing in a browser.
npx skills add https://github.com/agentbay-ai/agentbay-skills --skill web-scraper