Automated Sitemap Link Extraction and Google Sheets Integration

This workflow extracts sitemap links using the ScrapingBee API and appends them to a Google Sheet. It recursively processes new XML links found during sitemap scraping.

The workflow initiates with a webhook request containing a domain name. It first checks for a `robots.txt` file to find sitemap links, falling back to `sitemap.xml` if necessary. The workflow handles both text and binary responses, decompresses `.gz` files, and distinguishes between XML and non-XML links. Extracted website links are appended to a Google Sheet, while XML links trigger further recursive scraping to ensure all links are captured.
Platform
n8n
Category
Data & Analytics
Price
$14.99
Creator
Antonio Rossi

How to import this workflow into n8n

  1. 1Purchase or download the workflow to get the n8n workflow JSON file.
  2. 2In your n8n instance, open Workflows and choose "Import from File" (or paste the JSON with Ctrl+V on the canvas).
  3. 3Open each node marked with a credential warning and connect your own accounts and API keys.
  4. 4Run the workflow once manually to verify the data flow, then toggle it to Active.

Related Data & Analytics workflows

More from Antonio Rossi

Need this deployed? We'll set it up for you.

Our automation experts deploy this workflow in your stack, connect your accounts, and verify it works — or build a custom solution from scratch.