bb-browser

Turn any website into a CLI command. 36 platforms, 103 commands — Twitter, Reddit, GitHub, YouTube, Zhihu, Bilibili, Weibo, and more. Uses OpenClaw's browser...

yan5xu

@yan5xu

What This Skill Does

Command-line interface that extracts structured data from 36 websites (Twitter, Reddit, GitHub, YouTube, etc.) using OpenClaw's browser. Runs 103 pre-built adapters to scrape, search, and monitor content without needing separate browser extensions.

Replaces manual web scraping and browser extensions by turning any website into a CLI command with consistent flags and JSON output.

When to Use It

  • Search Twitter for recent posts about a topic
  • Monitor GitHub issues or pull requests for a repository
  • Extract YouTube video transcripts for analysis
  • Check trending stocks on Xueqiu or Eastmoney
  • Pull top posts from Reddit or Hacker News
  • Search Stack Overflow for code solutions

Install

$ openclaw skills install @yan5xu/bb-browser

bb-browser sites — The web as CLI

36 platforms, 103 commands. One-liner structured data from any website using your login state.

All commands use --openclaw to run through OpenClaw's browser. No Chrome extension or daemon needed.

Quick Start

# First time: pull community adapters
bb-browser site update

# See what's available
bb-browser site list

# See which adapters match your browsing habits
bb-browser site recommend

# Run any adapter via OpenClaw's browser
bb-browser site reddit/hot --openclaw
bb-browser site hackernews/top 5 --openclaw
bb-browser site v2ex/hot --openclaw

IMPORTANT: Always use --openclaw

Every bb-browser site command MUST include --openclaw to use OpenClaw's browser:

# Correct
bb-browser site twitter/search "AI agent" --openclaw
bb-browser site zhihu/hot 10 --openclaw --json
bb-browser site xueqiu/hot-stock 5 --openclaw --jq '.items[] | {name, changePercent}'

# Wrong (requires separate Chrome extension)
bb-browser site twitter/search "AI agent"

Data Extraction (most common use)

# Social media
bb-browser site twitter/search "OpenClaw" --openclaw
bb-browser site twitter/thread <tweet-url> --openclaw
bb-browser site reddit/thread <post-url> --openclaw
bb-browser site weibo/hot --openclaw
bb-browser site xiaohongshu/search "query" --openclaw

# Developer
bb-browser site github/repo owner/repo --openclaw
bb-browser site github/issues owner/repo --openclaw
bb-browser site hackernews/top 10 --openclaw
bb-browser site stackoverflow/search "async await" --openclaw
bb-browser site arxiv/search "transformer" --openclaw

# Finance
bb-browser site xueqiu/stock SH600519 --openclaw
bb-browser site xueqiu/hot-stock 5 --openclaw
bb-browser site eastmoney/stock "茅台" --openclaw

# News & Knowledge
bb-browser site zhihu/hot --openclaw
bb-browser site 36kr/newsflash --openclaw
bb-browser site wikipedia/summary "Python" --openclaw

# Video
bb-browser site youtube/transcript VIDEO_ID --openclaw
bb-browser site bilibili/search "query" --openclaw

Filtering with --jq

Use --jq to extract specific fields (no need for --json, it's implied):

# Just stock names
bb-browser site xueqiu/hot-stock 5 --openclaw --jq '.items[].name'

# Specific fields as objects
bb-browser site xueqiu/hot-stock 5 --openclaw --jq '.items[] | {name, changePercent, heat}'

# Filter results
bb-browser site reddit/hot --openclaw --jq '.posts[] | {title, score}'

View adapter details

# Check what args an adapter takes
bb-browser site info xueqiu/stock

# Search adapters by keyword
bb-browser site search reddit

Login State

Adapters run inside OpenClaw's browser tabs. If a site requires login:

  1. The adapter will return an error like {"error": "HTTP 401", "hint": "Not logged in?"}
  2. Log in to the site in OpenClaw's browser:
    openclaw browser open https://twitter.com
    
  3. Complete login manually in the browser window
  4. Retry the command

Creating New Adapters

Turn any website into a CLI command:

# Read the guide
bb-browser guide

# Or just tell me: "turn notion.so into a bb-browser adapter"
# I'll reverse-engineer the API, write the adapter, test it, and submit a PR.

All 36 Platforms

CategoryPlatforms
SearchGoogle, Baidu, Bing, DuckDuckGo, Sogou WeChat
SocialTwitter/X, Reddit, Weibo, Xiaohongshu, Jike, LinkedIn, Hupu
NewsBBC, Reuters, 36kr, Toutiao, Eastmoney
DevGitHub, StackOverflow, HackerNews, CSDN, cnblogs, V2EX, Dev.to, npm, PyPI, arXiv
VideoYouTube, Bilibili
EntertainmentDouban, IMDb, Genius, Qidian
FinanceXueqiu, Eastmoney, Yahoo Finance
JobsBOSS Zhipin, LinkedIn
KnowledgeWikipedia, Zhihu, Open Library
ShoppingSMZDM
ToolsYoudao, GSMArena, Product Hunt, Ctrip

Top skills in this category

Last30days Skill

@mvanhorn

Research what people actually say about any topic in the last 30 days. Pulls posts and engagement from Reddit, X, YouTube, TikTok, Hacker News, Polymarket, G...

198.2k

Demo Video Creator

@0xs4m1337

Create product demo videos by automating browser interactions and capturing frames. Use when the user wants to record a demo, walkthrough, product showcase, or interactive video of a web application. Supports Playwright CDP screencast for high-quality capture and FFmpeg for video encoding.

109.4k

SuperDesign

@mpociot

Expert frontend design guidelines for creating beautiful, modern UIs. Use when building landing pages, dashboards, or any user interface.

19341k

Video Frames

@steipete

Extract frames or short clips from videos using ffmpeg.

13355k

Playwright (Automation + MCP + Scraper)

@ivangdavila

Automates, tests, and debugs browsers with Playwright: locators, auto-waiting, traces, CI runs, and MCP browser control. Use when a test is flaky, times out, or fails only in CI or headless; when a locator matches multiple elements or the wrong one (strict mode violation); when clicks need force, waits become sleeps, or networkidle never settles; for storageState and login setup, request mocking and HAR replay, uploads and downloads, iframes and shadow DOM, popups and dialogs, screenshot diffs that change per machine, trace and report artifacts, sharding a slow suite, device and permission emulation, accessibility checks, driving a real browser through Playwright MCP, extracting data from JS-rendered pages, or porting a Cypress, Puppeteer, or Selenium suite to Playwright. Not for maintaining an existing Cypress or Puppeteer suite (cypress, puppeteer) or for work a plain HTTP request answers (http).

12839k