Web Scout
给 AI Agent 一键装上全网采集能力。基于 Agent Reach，支持 Twitter/X、Reddit、YouTube、B站、小红书、抖音、GitHub、LinkedIn、Boss直聘、RSS、全网搜索等平台。一条命令安装，零 API 费用。
子豪
@aizain
What This Skill Does
Web Scout installs a unified data collection toolkit for AI agents, supporting Twitter/X, Reddit, YouTube, Bilibili, Xiaohongshu, Douyin, GitHub, LinkedIn, Boss Zhipin, RSS, and web search via a single command. It uses Agent Reach to manage dependencies and platform-specific tools, requiring no API fees.
Replaces building separate scrapers or integrations for each social media and data platform by providing a single CLI-based installation and configuration workflow.
When to Use It
- Search Twitter/X for recent posts matching a keyword
- Extract subtitles or metadata from a YouTube or Bilibili video
- Fetch the latest entries from an RSS feed in a script
- Search GitHub repositories or view repository details and issues
- Scrape Xiaohongshu (Little Red Book) feeds and note details
- Parse Douyin (TikTok) video info from a share link
Install
$ openclaw skills install @aizain/web-scoutWeb Scout — AI Agent 全网采集工具箱
基于 Agent Reach 封装，让你的 AI Agent 一键获得全网信息采集能力。
支持平台
| 平台 | 工具 | 免费 | 需要配置 |
|---|---|---|---|
| 🌐 网页 | Jina Reader | ✅ | 无 |
| 📺 YouTube | yt-dlp | ✅ | 无 |
| 📺 B站 | yt-dlp | ✅ | 服务器需代理 |
| 📡 RSS | feedparser | ✅ | 无 |
| 🔍 全网搜索 | Exa (MCP) | ✅ | 自动配置 |
| 📦 GitHub | gh CLI | ✅ | 需登录 |
| 🐦 Twitter/X | xreach (bird) | ✅ | 需 Cookie |
| JSON API + Exa | ✅ | 服务器需代理 | |
| 📕 小红书 | xiaohongshu-mcp | ✅ | 需 Docker + Cookie |
| 🎵 抖音 | douyin-mcp-server | ✅ | 需 MCP 服务 |
| linkedin-mcp | ✅ | 需浏览器登录 | |
| 🏢 Boss直聘 | mcp-bosszp | ✅ | 需扫码登录 |
安装
第一步：安装 Agent Reach CLI
pip install https://github.com/Panniantong/agent-reach/archive/main.zip
第二步：自动安装依赖
默认模式（自动安装所有依赖）：
agent-reach install --env=auto
安全模式（只检查不安装，适合生产环境）：
agent-reach install --env=auto --safe
预览模式（只看会做什么）：
agent-reach install --env=auto --dry-run
第三步：检查状态
agent-reach doctor
第四步：按需配置平台
需要 Cookie 的平台建议使用小号，避免封号风险。
Cookie 导出方法：浏览器登录平台 → 安装 Cookie-Editor 插件 → Export → Header String → 发给 Agent。
配置 Twitter：
agent-reach configure twitter-cookies "COOKIE_STRING"
配置代理（服务器访问 Reddit/B站）：
agent-reach configure proxy http://user:pass@ip:port
配置小红书（需要 Docker）：
docker run -d --name xiaohongshu-mcp -p 18060:18060 xpzouying/xiaohongshu-mcp
mcporter config add xiaohongshu http://localhost:18060/mcp
常用命令速查
读网页
curl -s "https://r.jina.ai/URL"
搜索 Twitter/X
xreach search "关键词" --json
YouTube/B站 字幕提取
yt-dlp --dump-json "VIDEO_URL" # 视频信息
yt-dlp --write-sub --skip-download "URL" # 提取字幕
全网搜索（Exa）
mcporter call 'exa.search(query: "关键词", numResults: 10)'
GitHub
gh repo view owner/repo # 查看仓库
gh search repos "关键词" # 搜索仓库
gh issue list -R owner/repo # 查看 Issue
RSS
python3 -c "import feedparser; f=feedparser.parse('RSS_URL'); [print(e.title) for e in f.entries[:10]]"
小红书
mcporter call 'xiaohongshu.search_feeds(keyword: "关键词")'
mcporter call 'xiaohongshu.get_feed_detail(note_id: "ID")'
抖音
mcporter call 'douyin.parse_douyin_video_info(share_link: "分享链接")'
mcporter call 'exa.search(query: "site:reddit.com 关键词")'
维护
检查更新：
agent-reach check-update
升级：
pip install --upgrade https://github.com/Panniantong/agent-reach/archive/main.zip
健康检查（适合定时任务）：
agent-reach watch
卸载：
agent-reach uninstall # 完整卸载
agent-reach uninstall --keep-config # 保留配置
pip uninstall agent-reach # 卸载 Python 包
安全说明
- Cookie 只存本地
~/.agent-reach/config.yaml，文件权限 600 - 代码完全开源，可审查
- 需要 Cookie 的平台（Twitter、小红书）建议用小号
- 支持
--safe和--dry-run模式
致谢
基于 Agent Reach by Panniantong，MIT 协议。
Top skills in this category
SuperDesign
@mpociotExpert frontend design guidelines for creating beautiful, modern UIs. Use when building landing pages, dashboards, or any user interface.
Video Frames
@steipeteExtract frames or short clips from videos using ffmpeg.
YouTube
@byungkyuYouTube Data API integration with managed OAuth. Search videos, manage playlists, access channel data, and interact with comments. Use this skill when users want to interact with YouTube. For other third party apps, use the api-gateway skill (https://clawhub.ai/byungkyu/api-gateway). Calls run through the `maton` CLI with OAuth login, or over raw HTTP with a Maton API key where the CLI cannot be installed. Every call is authenticated as the user's connection and reaches only what that connection's authorization allows, which the provider enforces on every request; the endpoints documented here are the ones this skill uses, and any other endpoint of this app needs the user to ask for it by name. Default to read and list calls, and confirm every write or new connection with the user. This file also documents the three constructs that turn a YouTube connection into automation, in the order they are used: the connection (the first step), a hosted function that runs a YouTube action through the Maton SDK, and a trigger that calls that function on a schedule or on an event. Those sections are the platform's own reference text, shared with the api-gateway skill, with YouTube examples; they add no YouTube capability - YouTube is not an event source, a trigger cannot read YouTube data, and the files under `references/<source>/triggers.md` are the platform's event catalogues for the sources Maton offers (time, Calendly, GitHub, Gmail, HubSpot, Linear, Notion, Slack, Stripe).
Frontend Design
@michaelmonetizedCreate distinctive, production-grade frontend interfaces with high design quality. Use this skill when building web components, pages, or applications. Generates creative, polished code that avoids generic AI aesthetics.
Remotion Video Toolkit
@shreefentsarComplete toolkit for programmatic video creation with Remotion + React. Covers animations, timing, rendering (CLI/Node.js/Lambda/Cloud Run), captions, 3D, charts, text effects, transitions, and media handling. Use when writing Remotion code, building video generation pipelines, or creating data-driven video templates.