Use Open-Source LLM via HuggingFace for Chat Automation
Demonstrates integrating an open-source LLM like Mistral-7B from HuggingFace into an n8n chat workflow using a Basic LLM Chain for guided responses.
This n8n workflow showcases how to connect open-source language models from HuggingFace to a Basic LLM node. It triggers on new manual chat messages and processes them through a Language Model Chain configured with a custom prompt that provides clear guidance, such as 'You are a helpful assistant. Please reply politely... Q: {{ $json.input }} A:'. This structured prompting is essential for smaller open-source models to generate coherent, polite responses with emojis.
The workflow uses the Mistral-7B-Instruct-v0.1 model by default but allows easy switching to other HuggingFace-supported LLMs. Note that the HuggingFace node operates in inference mode, limiting it to chains rather than agents; for agents, use the Ollama Chat Model node instead. A sticky note provides setup details and prompt examples for optimal performance.
Benefits include cost-free access to powerful open-source AI without API fees, customizable prompting for specific behaviors, and seamless n8n integration for chatbots or automation. Use cases span customer support bots, interactive Q&A systems, content generation, or prototyping AI assistants. Requires n8n version 1.19.4+ for compatibility.
New buyers can create an account from the cart to unlock a controlled $10 first-purchase credit on eligible orders of $25+.
Related bundle
WhatsApp Business Automation
7 workflows for $39.00 (save 52%).
$82.94 if bought separately.
View bundleSecure checkout powered by Stripe
Support
How to import this workflow into n8n
- 1Purchase or download the workflow to get the n8n workflow JSON file.
- 2In your n8n instance, open Workflows and choose "Import from File" (or paste the JSON with Ctrl+V on the canvas).
- 3Open each node marked with a credential warning and connect your own accounts and API keys.
- 4Run the workflow once manually to verify the data flow, then toggle it to Active.
Related Crypto & Blockchain workflows
- Real-time Crypto Insights with CoinMarketCap and AI via Telegram$14.99
- Automated Multi-Timeframe Trading Analysis for WEEX Spot Market with GPT-4 and Telegram$24.99
- Automate Crypto News Digest to Telegram with RSS and GPT-4$14.99
- Automate AI-Driven Stock Trading with Alpaca and Google Sheets$14.99
- Automated Crypto RSI Alerts with EODHD and Telegram Integration$9.99
- Automate Binance Spot Trading with Limit and Market Orders$14.99
More from Leandro Rossi
Need this deployed? We'll set it up for you.
Our automation experts deploy this workflow in your stack, connect your accounts, and verify it works — or build a custom solution from scratch.