raulvidis
hermes-cloudflare
Cloudflare Browser Rendering plugin for hermes-agent — crawl, scrape, and extract content from web pages.
Repository last updated Jul 23, 2026
Overview
This plugin integrates Cloudflare's Browser Rendering API into the Hermes Agent ecosystem, enabling web crawling and content extraction from JavaScript-heavy websites. It leverages Cloudflare's headless browser infrastructure to perform tasks like CSS-selector scraping, PDF generation, and full-page screenshot capture.
The tool also features AI-powered structured data extraction using Llama 3.3 70B via Workers AI. Users can automate complex web workflows including sitemap discovery and Markdown conversion directly through agent commands.
Designed for developers and data engineers who need to extract content from modern web applications that rely heavily on JavaScript rendering, this plugin provides a seamless way to integrate browser automation into agent-driven workflows.
Highlights
- Crawls websites with depth controls and sitemap discovery support
- Extracts structured JSON data using Workers AI and Llama 3.3
- Converts fully rendered JavaScript-heavy pages into clean Markdown
- Takes full-page screenshots and generates PDFs with custom settings
- Scrapes elements using CSS selectors with text, HTML, and attributes
Features
Web Crawling
Async website crawling with depth/limit controls, format selection (HTML/Markdown/JSON), include/exclude patterns, and sitemap discovery.
CSS-Selector Scraping
Extract text, HTML, attributes, and dimensions from elements using CSS selectors.
AI-Powered Data Extraction
Use Workers AI with Llama 3.3 70B to extract structured JSON data based on a prompt and schema.
Markdown Conversion
Convert fully rendered JavaScript-heavy pages into clean Markdown.
Screenshots and PDFs
Capture full-page or element screenshots (PNG/JPEG/WebP) and generate PDFs with headers, footers, margins, and scale.
Link Discovery
Discover links with visible-only and external domain filtering.
Installation
Commands are reproduced exactly as published by the project maintainers. Always check the upstream repository for the current instructions.
curl -sSL https://raw.githubusercontent.com/raulvidis/hermes-cloudflare/main/install.sh | bashgit clone https://github.com/raulvidis/hermes-cloudflare.git
mkdir -p ~/.hermes/plugins
cp -r hermes-cloudflare/hermes-cloudflare-plugin ~/.hermes/plugins/hermes-cloudflare
pip install httpxRequirements
- hermes-agent v0.3.0+
- Python 3.10+
- httpx (installed automatically by install.sh)
- Cloudflare account with Browser Rendering enabled (Free and Paid plans)
How it's built
The plugin is written in Python and consists of a single package hermes-cloudflare-plugin placed in the Hermes Agent plugins directory. It uses httpx for HTTP requests to Cloudflare's Browser Rendering API. The repository layout includes install.sh for quick setup, requirements.txt for dependencies, and a plugin.yaml for Hermes Agent integration.
Each tool corresponds to a function exposed to the agent: cf_crawl, cf_scrape, cf_markdown, cf_json_extract, cf_links, cf_content, cf_screenshot, and cf_pdf. Configuration is handled via environment variables CLOUDFLARE_API_TOKEN and CLOUDFLARE_ACCOUNT_ID.
Source
This summary was written for Neura Market from the project's own repository. Install commands, identifiers and licence details are reproduced unchanged. The raulvidis/hermes-cloudflare repository is the authoritative source and the place to file issues or contribute.
Category: Browser Automation