Automate Multipage Website Scraping with Jina.ai and Google Drive - n8n Workflow | Neura Market
Automate Multipage Website Scraping with Jina.ai and Google Drive
This n8n workflow automates the process of scraping multiple pages from a website's sitemap using Jina.ai and stores the content in Google Drive. It efficiently extracts and formats webpage content into markdown, making it easy to manage and access.
The workflow begins by setting a sitemap URL to extract individual page URLs. It filters these URLs based on specific topics or pages, then uses Jina.ai's web scraper to extract content, converting it into markdown format. Each page's content is saved as a separate Google Drive document, named using the page's title for easy identification. The workflow includes rate limiting to prevent server overload and supports batch processing for large sitemaps.
Platform
n8n
Category
AI
Price
Free
Creator
Mateo Fernandez
set
xml
code
wait
limit
filter
splitOut
stickyNote
googleDrive
httpRequest
How to import this workflow into n8n
1Purchase or download the workflow to get the n8n workflow JSON file.
2In your n8n instance, open Workflows and choose "Import from File" (or paste the JSON with Ctrl+V on the canvas).
3Open each node marked with a credential warning and connect your own accounts and API keys.
4Run the workflow once manually to verify the data flow, then toggle it to Active.