Automated LLM Evaluation for Legal Benchmarking
Evaluates LLMs on legal test cases from Google Sheets using GPT-4 as judge, scoring pass/fail with reasons and logging results back to Sheets.
This n8n workflow automates the benchmarking of large language models (LLMs) on a dataset of legal information extraction tasks. It pulls test cases from a Google Sheet, processes each by retrieving source documents via Google Drive, converting them to text, and submitting the LLM's input/output to a GPT-4.1 'judge' via OpenRouter for evaluation (Pass/Fail + reasoning). Results are appended to an output sheet in real-time, with a 0.5s pause to respect API rate limits.
Key benefits include effortless scaling for testing multiple LLMs (e.g., 6 models on 18 cases), objective scoring via a superior LLM judge, and easy customization for your own datasets. It saves hours of manual eval work, ideal for AI product managers validating model performance.
Use cases: Legal AI benchmarking, LLM comparison for RAG/extraction tasks, continuous eval pipelines in product dev, or adapting to any domain by swapping sheets. Setup requires Google Sheets/Drive creds, OpenRouter API key, and copying the sample spreadsheet.
New buyers can create an account from the cart to unlock a controlled $10 first-purchase credit on eligible orders of $25+.
Related bundle
n8n Starter Kit
8 workflows for $39.00 (save 56%).
$89.92 if bought separately.
View bundleSecure checkout powered by Stripe
Support
How to import this workflow into n8n
- 1Purchase or download the workflow to get the n8n workflow JSON file.
- 2In your n8n instance, open Workflows and choose "Import from File" (or paste the JSON with Ctrl+V on the canvas).
- 3Open each node marked with a credential warning and connect your own accounts and API keys.
- 4Run the workflow once manually to verify the data flow, then toggle it to Active.
Related Development & IT workflows
- Create daily historical AI videos with Gemini, fal.ai, Telegram and YouTube$14.99
- Advanced multi-agent AI personal assistant with 250+ task capabilities (WhatsApp + GPT)$2.99
- Send Organized Security CVE Digests from NVD with AI-Polished Summaries to Gmail$4.99
- Learn n8n basics in 3 easy steps ✨$14.99
- Automated multi-platform sales agent with RAG, CRM & payment processing$2.99
- Version Control n8n Workflows in GitLab with Custom and Organization$14.99
More from Viktor Guerrero
Need this deployed? We'll set it up for you.
Our automation experts deploy this workflow in your stack, connect your accounts, and verify it works — or build a custom solution from scratch.