All Documents
3,528 documents available
Evaluation Benchmarking Framework for Token-Optimized RAG
Evaluation & Benchmarking Framework for TokenOptimized RAG
Evaluating generative systems
Explains reference-based and reference-free evaluation workflows for generative LLM systems, including metric types and dataset-level vs row-level scoring.
17. Evaluation Frameworks
title: 17. Evaluation Frameworks
Comprehensive Evaluation Plan (Version 2)
Defines a multi-week evaluation plan for an AI receipt-scanning app, covering accuracy, latency, user testing, safety audits, and cost tracking.
RAG Evaluation Patterns (Apr 2026)
Defines a layered evaluation strategy for RAG systems using the RAG Triad, RAGAS metrics, and automated regression testing.
UI Preview Guide
Lists six ways to preview UI components locally, including a dedicated mock-data preview page and optional Storybook setup.
Agent and LLM Evaluation Practices
Organises LLM and agent evaluation into six dimensions, three metric families, five techniques, and AWS-native tooling.
🤖 機械学習・データ可視化プレビューガイド
Documents a preview system for TensorFlow MNIST training, matplotlib visualizations, and pandas analysis inside a Docker container.
Evaluating the RAG answer quality
Walks through deploying an evaluation model, generating ground truth, and running bulk evaluations on RAG answer quality.
Example: LLM-as-judge for answer quality
Teaches evaluation strategies for AI agents, covering offline/online evals, RAGAS metrics, LLM-as-judge, and a complete feedback loop with tracing.
LLM Evaluation
Defines automated metrics, human evaluation, LLM-as-judge patterns, A/B testing, and regression detection for LLM applications.
evaluation_driven_development
Introduces evaluation-driven development for AI, treating evals as first-class artifacts to measure output quality and guard against regressions.
prompt-eval-designer
Guides an LLM through designing a complete evaluation framework: criteria, rubrics, test cases, judge prompt, and decision thresholds for any application.
Context-Aware RAG Agent: Flow & Evaluation Plan
Documents the execution flow, offline evaluation pipeline, and resource constraints for a context-aware RAG system using RAGAs metrics.
Evaluation Plan v2 — Cognify
Defines metrics, methods, golden set, user testing protocol, and timeline for evaluating a course-material-to-summary/quiz/glossary tool.
🚀 Guia Completo para Revisão da Meta - Garantindo Aprovação
Guides you through preparing a Facebook app review for WhatsApp Business API approval, with checklists, templates, and deployment steps.
Content Preview Guide
Explains five preview modes, HTML preservation, media handling, and CSS styling for a WordPress paywall plugin's content teaser system.
Hybrid Preview Implementation - Complete! ✅
Documents a hybrid preview system that auto-compiles React Native mobile apps to web for instant browser previews via WebContainer.
System Review Guide (IBS v5)
Serves as an architecture and code quality review checklist for a Next.js airline dashboard with multi-screen support.
🤖 Cursor PR Review Guide for Dependabot PRs
Guides a developer through reviewing 12 Dependabot pull requests using Cursor's GitHub integration and AI-assisted commands.
Comprehensive Log Review and Anomaly Detection Guide
Defines a complete log review and anomaly detection framework for an AI trading bot, with automated scheduling, risk scoring, and alert management.
AICL Public Review Guide
Guides first-time reviewers through the AICL research specification, explaining what it is, how to review it, and what feedback helps.
Tutorial Review Guide
Lists 12 tutorials across three phases with run commands, key files, and review checkpoints for a genomic visualization platform.
App Store Submission - Quick Reference Guide
Provides a quick reference for submitting a wellness app to app stores, including demo mode instructions, testing checklists, and positioning guidance.