Web Fetcher is a CLI tool that automatically detects platforms and applies the best strategy to fetch articles or download videos for offline reading, arch…
Web Fetcher is a CLI tool that automatically detects platforms and applies the best strategy to fetch articles or download videos for offline reading, archiving, or research. It routes URLs to platform-specific handlers (WeChat, Feishu virtual scroll, Zhihu, Toutiao, Xiaohongshu/Weibo via a stealth camoufox browser, Bilibili/YouTube/Douyin via yt-dlp) and falls back to generic scraping with scrapling. Key features include runtime dependency checks, batch URL input, output directory control, image and data-src extraction, SVG/placeholder handling, cookie-aware downloads, quality selection for video, and optional HTML-to-Markdown conversion. Use cases include content curation, academic or market research, building datasets, and automating backups of web articles and videos. Core advantages are smart routing, minimal upfront installs, anti-bot support, and scriptable CLI integration.
This page belongs to the OpenClaw Skills learning hub with install guides, category navigation, and practical links.