Convert URL HTML to Markdown & Extract Page Links
Uses Firecrawl.dev API to convert webpage HTML to clean Markdown format and extract all links, with built-in batch processing and rate limiting for efficient data extraction.
This n8n workflow automates the transformation of web page HTML into AI-friendly Markdown format while simultaneously extracting all hyperlinks from the pages. It leverages the Firecrawl.dev API to handle scraping, conversion, and link detection in a single API call, ensuring clean, structured output without manual parsing or HTML tags. The workflow processes URLs in batches from a database input (using a 'Page' column), respects API rate limits via automated waits, and outputs the results to your preferred database for further use in LLMs, content analysis, or knowledge bases.
Key benefits include time savings on web data preparation, reduced complexity in handling scraping challenges like JavaScript rendering (Firecrawl manages this), and scalability for large URL lists. By batching requests and inserting delays (e.g., 45-second waits), it prevents API throttling, making it reliable for production use. The output provides both Markdown content and a list of extracted links, enabling downstream workflows for crawling linked pages or content indexing.
Ideal use cases: Preparing web content for LLM training or RAG systems; building automated content pipelines for newsletters or research; extracting site maps or internal links for SEO audits; or archiving web pages in a readable format. Setup is straightforward: add your Firecrawl API key, connect input/output databases, and adjust batch sizes or wait times as needed. It's perfect for developers and data teams needing robust, no-code web extraction.
New buyers can create an account from the cart to unlock a controlled $10 first-purchase credit on eligible orders of $25+.
Related bundle
n8n Starter Kit
8 workflows for $39.00 (save 56%).
$89.92 if bought separately.
View bundleSecure checkout powered by Stripe
Tags
Support
How to import this workflow into n8n
- 1Purchase or download the workflow to get the n8n workflow JSON file.
- 2In your n8n instance, open Workflows and choose "Import from File" (or paste the JSON with Ctrl+V on the canvas).
- 3Open each node marked with a credential warning and connect your own accounts and API keys.
- 4Run the workflow once manually to verify the data flow, then toggle it to Active.
Related Development & IT workflows
- Create daily historical AI videos with Gemini, fal.ai, Telegram and YouTube$14.99
- Advanced multi-agent AI personal assistant with 250+ task capabilities (WhatsApp + GPT)$2.99
- Send Organized Security CVE Digests from NVD with AI-Polished Summaries to Gmail$4.99
- Learn n8n basics in 3 easy steps ✨$14.99
- Automated multi-platform sales agent with RAG, CRM & payment processing$2.99
- Version Control n8n Workflows in GitLab with Custom and Organization$14.99
More from Saskia Kowalczyk
Need this deployed? We'll set it up for you.
Our automation experts deploy this workflow in your stack, connect your accounts, and verify it works — or build a custom solution from scratch.