Fetch Website Content, Gemini Embeddings to Pinecone KB

Fetches all pages from a website via sitemap or URLs, extracts clean text, generates Gemini embeddings, and stores in Pinecone for semantic search and RAG chatbots.

n8n
Fetch Website Content, Gemini Embeddings to Pinecone KB

This n8n workflow automates the complete process of building a knowledge base from any website. It starts by collecting URLs from a provided sitemap XML or a manual list, parses the sitemap to extract all page links, merges them, and removes duplicates for efficiency. Then, it iterates through the unique URLs, politely fetching HTML content with delays to respect server limits.

Next, it processes the HTML to extract meaningful text from the page body, stripping out images, scripts, and noise for high-quality input. Google Gemini's embedding model converts this text into dense vector representations that capture semantic meaning. Finally, these embeddings, along with metadata and original content, are upserted into a Pinecone vector index, enabling fast similarity searches.

Benefits include massive time savings over manual scraping and indexing, scalability for large sites, and readiness for AI applications. Use cases: Populate custom chatbots with site-specific knowledge (RAG), create internal search engines, build product catalogs for e-commerce AI, or archive content for analytics. Note: Incur costs from Pinecone/Pinecone usage and Gemini API; check regional model availability.

$24.99
Last updated November 14, 2026
30-day money-back guarantee
Instant download
Lifetime updates included

New buyers can create an account from the cart to unlock a controlled $10 first-purchase credit on eligible orders of $25+.

Secure checkout powered by Stripe

Support

How to import this workflow into n8n

  1. 1Purchase or download the workflow to get the n8n workflow JSON file.
  2. 2In your n8n instance, open Workflows and choose "Import from File" (or paste the JSON with Ctrl+V on the canvas).
  3. 3Open each node marked with a credential warning and connect your own accounts and API keys.
  4. 4Run the workflow once manually to verify the data flow, then toggle it to Active.

Related Development & IT workflows

More from Bryce Yu

Need this deployed? We'll set it up for you.

Our automation experts deploy this workflow in your stack, connect your accounts, and verify it works — or build a custom solution from scratch.