All Documents
3,528 documents available
Code Challenge 4 Sanitized Rubric
Provides a rubric for grading a React code challenge, with scoring criteria for props, state, code structure, and rendering.
FIFO Evals Client - Migration Guide
Replaces a synchronous evaluation script that times out on large jobs with an async FIFO queue client that handles up to 10,000 prompts without failure.
File Processing API Specification
Defines a Go API for secure file processing with validation, error handling, and optional performance optimizations.
BIOF-309, Spring 2020 Rubric
Defines a grading scheme for a Python course with homework, a mini-project, and a final project, plus a detailed rubric for the final project.
Hybrid RAG Chatbot Tasks
Tracks a RAG chatbot's development backlog with 30+ completed and 20+ planned tasks across monitoring, retrieval, and UX.
Introduction
Defines when WG21 proposals should be reviewed by SG16, the text and Unicode study group.
Sokuji Evaluation Framework
Defines a structured evaluation framework for AI translation quality using LLM-as-Judge scoring and instruction override A/B testing.
proj1rubric
Scores a software project against a 90-item rubric covering documentation, testing, community, and licensing practices.
pyttb User Guide and Rubric
Guides users of the pyttb tensor package by categorising features by skill level and linking to tutorials, issues, and API docs.
Eval Learnings
Documents six evaluation rounds that validate parameter recovery, autodiff correctness, influence function assembly, and frequentist coverage for a deep inference package.
Fission — NEAR Track
Explains how Fission's AI agent meets NEAR track requirements for autonomous governance and data analysis on the NEAR AI Agent Hub.
QuantTradeAI - LLM Agent Guide
Defines architecture, development workflow, and coding standards for a quantitative trading ML framework with ensemble models and backtesting.
Software Carbon Intensity for AI Specification
Extends the SCI methodology to AI systems, defining how to measure and report carbon emissions across AI lifecycles and personas.
The ustack: Complete Reference for LLMs
Documents a nine-library web stack built on radical minimalism, data-structure DSLs, and an ES5 subset, with under 3300 total lines.
Product Requirements Document: Unleash MCP Server
Defines the product vision, goals, and phased delivery plan for an MCP server that creates and wraps code changes with Unleash feature flags.
Responsible AI (RAI)
Documents where AI is used, model choices, guardrails, cost controls, and risk mitigations for an LLM-based system.
Presentation Evaluator — Prototype Plan
Defines an 8-module pipeline that evaluates academic presentations from recorded video, extracting speech, prosody, body language, and language metrics against TED talk benchmarks.
List evals
Documents the GET /evals endpoint for listing evaluations, including query parameters, response structure, and grader types.
DFAH: Determinism-Faithfulness Assurance Harness
A harness for measuring whether LLM agents produce consistent, auditable behavior when given the same input multiple times.
Logging & Evals
Documents a trigger-based logging system, cost tracking, token analytics, and a separate evals dashboard for reviewing LLM interactions.
Comprehensive Agentic AI Learning Plan for ML Engineers
Outlines an 8-week curriculum for ML engineers to build agentic AI systems, from basic agents to production deployment.
Demo Walkthrough
Walks through querying a pre-populated Qdrant RAG system for a Boeing 737 manual, including health checks, example queries, and evaluation commands.
CDR Evaluation
> How we measure output quality, and what the numbers mean.
Triggering Evals via GitHub Actions
Documents how to trigger eval runs remotely via `gh workflow run` with 14 configurable inputs and example commands for five benchmarks.