Web Content Fetcher
网页内容获取工具 | 当常规爬虫被过滤时，使用替代服务获取网页内容。支持：1) r.jina.ai - 最稳定 2) markdown.new - Cloudflare 专用 3) defuddle.md - 备用方案。触发词：获取网页内容、网页转markdown、内容抓取、fetch webpage、bypas...
MRTommyWU
@mrtommywu
What This Skill Does
Fetches web page content as Markdown using alternative services when standard crawlers are blocked. Supports three fallback services: r.jina.ai (most stable), markdown.new (for Cloudflare-protected sites), and defuddle.md (backup).
Replaces manual workarounds for blocked web scraping by providing a tiered set of reliable, Markdown-returning fetch services.
When to Use It
- Fetch content from a website that blocks standard web_fetch tools
- Extract readable Markdown from a Cloudflare-protected page
- Retrieve article text from a news site that normally requires a scraper
- Get a clean, structured version of a web page for further processing
- Bypass anti-bot measures to access publicly available web content
Install
$ openclaw skills install @mrtommywu/web-content-fetcher网页内容获取工具
当常规 web_fetch/web_search 无法获取内容时，使用替代服务获取网页 Markdown 格式内容。
支持的服务
| 优先级 | 服务 | 用法 | 适用场景 |
|---|---|---|---|
| 1 | r.jina.ai | https://r.jina.ai/{url} | 最稳定，通用性强 |
| 2 | markdown.new | https://markdown.new/{url} | Cloudflare 保护网站 |
| 3 | defuddle.md | https://defuddle.md/{url} | 备用方案 |
使用方法
直接调用
当需要获取网页内容时，按顺序尝试：
- 首先用
web_fetch尝试获取 - 如果失败或被过滤，调用本工具
# 使用 jina.ai (首选)
curl -s "https://r.jina.ai/https://example.com"
# 使用 markdown.new (Cloudflare)
curl -s "https://markdown.new/https://example.com"
# 使用 defuddle.md (备用)
curl -s "https://defuddle.md/https://example.com"
API 格式
# 简单获取
fetch_webpage <url>
# 指定方法
fetch_webpage <url> --method jina|markdown|defuddle
示例
用户: 帮我获取 https://news.example.com/article/123 的内容
助手: (使用 r.jina.ai 获取)
工具脚本
本目录包含 fetch.sh 脚本，可直接调用：
./fetch.sh https://example.com
./fetch.sh https://example.com jina
让网页内容获取不再受限 🌐
Top skills in this category
AI Daily Briefing
@jeffjhunterStart every day focused. Get a morning briefing with overdue tasks, today's priorities, calendar overview, and context from recent meetings. Works with ai-meeting-notes to-do list. No setup. Just say 'briefing'.
ADHD Assistant
@thinktankmachineADHD-friendly life management assistant for OpenClaw. Helps with daily planning, task breakdown, time management, prioritization, body doubling, dopamine regulation, and maintaining routines. Use when the user asks for help organizing their life, staying on top of tasks, beating procrastination, planning their day/week, managing overwhelm, or mentions ADHD-related challenges like time blindness, forgetfulness, difficulty starting tasks, or emotional dysregulation.
Dingtalk Ai Table
@aliramw钉钉 AI 表格（多维表）操作技能。使用 mcporter CLI 连接钉钉官方新版 AI 表格 MCP server，基于 baseId / tableId / fieldId / recordId 体系执行 Base、Table、Field、Record 的查询与增删改。适用于创建 AI 表格、搜索表格、读取...
Task Monitor
@jorgermpReal-time web dashboard for OpenClaw sessions and background tasks. Mobile-responsive with auto-refresh.
openclaw-nextcloud
@keithvassallomtManage Notes, Tasks, Calendar, Files, Contacts, and Deck Kanban boards in your Nextcloud instance via CalDAV, WebDAV, Notes, and Deck APIs. Use for creating notes, managing todos and calendar events, uploading/downloading files, managing contacts, and organizing Kanban boards, stacks, and cards.