Automated LLM Evaluation for Legal Benchmarking

Evaluates LLMs on legal test cases from Google Sheets using GPT-4 as judge, scoring pass/fail with reasons and logging results back to Sheets.

n8n
Automated LLM Evaluation for Legal Benchmarking

This n8n workflow automates the benchmarking of large language models (LLMs) on a dataset of legal information extraction tasks. It pulls test cases from a Google Sheet, processes each by retrieving source documents via Google Drive, converting them to text, and submitting the LLM's input/output to a GPT-4.1 'judge' via OpenRouter for evaluation (Pass/Fail + reasoning). Results are appended to an output sheet in real-time, with a 0.5s pause to respect API rate limits.

Key benefits include effortless scaling for testing multiple LLMs (e.g., 6 models on 18 cases), objective scoring via a superior LLM judge, and easy customization for your own datasets. It saves hours of manual eval work, ideal for AI product managers validating model performance.

Use cases: Legal AI benchmarking, LLM comparison for RAG/extraction tasks, continuous eval pipelines in product dev, or adapting to any domain by swapping sheets. Setup requires Google Sheets/Drive creds, OpenRouter API key, and copying the sample spreadsheet.

$16.99
Last updated November 14, 2026
30-day money-back guarantee
Instant download
Lifetime updates included

New buyers can create an account from the cart to unlock a controlled $10 first-purchase credit on eligible orders of $25+.

Secure checkout powered by Stripe

Support

How to import this workflow into n8n

  1. 1Purchase or download the workflow to get the n8n workflow JSON file.
  2. 2In your n8n instance, open Workflows and choose "Import from File" (or paste the JSON with Ctrl+V on the canvas).
  3. 3Open each node marked with a credential warning and connect your own accounts and API keys.
  4. 4Run the workflow once manually to verify the data flow, then toggle it to Active.

Related Development & IT workflows

More from Viktor Guerrero

Need this deployed? We'll set it up for you.

Our automation experts deploy this workflow in your stack, connect your accounts, and verify it works — or build a custom solution from scratch.