Automates benchmarking of multiple local LLMs with LM Studio, testing prompts, measuring metrics like readability, word count, and response time, and logging results to Google Sheets.
This n8n workflow enables developers, researchers, and marketers to efficiently benchmark multiple local Large Language Models (LLMs) running via LM Studio. It dynamically fetches active models, applies configurable parameters like temperature and top P, sends test prompts to each model, captures responses, and computes key performance metrics including response time, word count, and readability scores (e.g., Flesch-Kincaid ranges from very easy to standard readability).
Results are automatical
Platform
n8n
Category
Marketing
Price
$14.99
Creator
Jordi Faber
LLM
Benchmarking
LM Studio
Google Sheets
AI Testing
Performance Tracker
Prompt Engineering
Readability Analysis
Marketing AI
Local Models
How to import this workflow into n8n
1Purchase or download the workflow to get the n8n workflow JSON file.
2In your n8n instance, open Workflows and choose "Import from File" (or paste the JSON with Ctrl+V on the canvas).
3Open each node marked with a credential warning and connect your own accounts and API keys.
4Run the workflow once manually to verify the data flow, then toggle it to Active.