China News Crawler

A straightforward news scraper that pulls article content from 12 platforms including WeChat Official Accounts, Toutiao, BBC, CNN, and Twitter, then outputs both JSON and Markdown. It auto-detects the platform from the URL and handles the HTTP juggling with curl_cffi for browser impersonation. The Twitter support is nice because it works with public tweets out of the box and accepts cookies for protected ones. Built with uv for dependency management and includes all the crawler code in one package, so you can lift it into another project without hunting down pieces. Good for when you need clean article extraction without building parsers for each platform yourself.

Install to Claude Code

npx -y skills add nanmicoder/newscrawler --skill china-news-crawler --agent claude-code