Generate AI-Ready llms.txt Files from Screaming Frog Crawls
Automates creation of llms.txt files from Screaming Frog CSV exports via a simple form, with optional AI filtering for relevant URLs. Ideal for preparing website data for LLMs.
This n8n workflow transforms Screaming Frog's internal_html CSV exports into optimized llms.txt files, which are structured for easy ingestion by large language models (LLMs). Users input the website name, a short description, and upload the CSV via a form-trigger node. The workflow processes the data, extracts relevant HTML content from URLs, and compiles it into a downloadable llms.txt file directly from the n8n UI.
Key features include an optional AI-powered text classifier node (deactivated
Platform
n8n
Category
Healthcare
Price
$14.99
Creator
Bryce Yu
SEO
Screaming Frog
llms.txt
AI Filtering
Data Extraction
Website Crawling
CSV Processing
n8n Automation
Text Classification
Healthcare Data
How to import this workflow into n8n
1Purchase or download the workflow to get the n8n workflow JSON file.
2In your n8n instance, open Workflows and choose "Import from File" (or paste the JSON with Ctrl+V on the canvas).
3Open each node marked with a credential warning and connect your own accounts and API keys.
4Run the workflow once manually to verify the data flow, then toggle it to Active.