Education & Training
EVALS.md ยท 21 documents
Domain 5: Testing, Validation, and Troubleshooting
Maps the AIP-C01 exam Domain 5 topics, evaluation systems, metrics, and troubleshooting, into a structured study guide with code examples and exam tips.
Training Readiness Checklist
Lists five gates to verify before launching a training or tuning run, with checkboxes for each item.
LLM Evaluation โ Interview Grill
Presents 115 active-recall questions across 14 sections to test and reinforce knowledge of LLM evaluation concepts.
Lesson 01: Evaluation Frameworks Overview
Teaches a taxonomy of LLM evaluation approaches and compares five frameworks for offline and online testing.
prompt-eval-designer
Guides an LLM through designing a complete evaluation framework: criteria, rubrics, test cases, judge prompt, and decision thresholds for any application.
AICL Public Review Guide
Guides first-time reviewers through the AICL research specification, explaining what it is, how to review it, and what feedback helps.
Training FAQ
Answers common questions about metrics, KL divergence, text generation settings, and debugging for RLHF training with PPO.
Structuring Machine Learning Project
Collects Andrew Ng's guidance on setting up dev/test sets, evaluation metrics, error analysis, and diagnosing bias, variance, and data mismatch.
Questions and Answers to Supervised Learning.
Answers student questions about supervised learning, covering SVM, kernels, overfitting, cross-validation, and performance metrics.
End-of-term exam
Lists NLP and Python topics for an oral exam, with logistics for online Teams sessions.
Motivating Principles
Sets editorial standards for a curated list of Bitcoin Cash projects, prioritising active, adopted, open-source software.
Introduction
Explains how CSS properties affect page paint times using a custom Skia-based benchmarking setup, with data and advice for developers.
๐ค What is this?
Serves as a checklist of backend development best practices covering repository setup, code style, testing, API design, and CRUD operations.
๐ Ultra-Advanced Features - FWG Training Guide
Catalogs three ultra-advanced interactive features, adaptive AI tutor, secure code sandbox, and CTF platform, that turn a documentation repo into a production-ready learning platform.
Code Challenge 4 Sanitized Rubric
Provides a rubric for grading a React code challenge, with scoring criteria for props, state, code structure, and rendering.
proj1rubric
Scores a software project against a 90-item rubric covering documentation, testing, community, and licensing practices.
pyttb User Guide and Rubric
Guides users of the pyttb tensor package by categorising features by skill level and linking to tutorials, issues, and API docs.
Presentation Evaluator โ Prototype Plan
Defines an 8-module pipeline that evaluates academic presentations from recorded video, extracting speech, prosody, body language, and language metrics against TED talk benchmarks.
MLOps Learning Path (GCP Focused - Solid, Comprehensive & Practical)
Outlines a four-stage MLOps learning path centered on GCP Vertex AI, with resources and hands-on exercises for each stage.
LAB3-INSTRUCTIONS
Guides students through four encryption tasks using openssl and gpg, including symmetric/asymmetric encryption, encrypted email, and digital signatures.
Work in progress: Batched LLM inference
Shows how to validate structured JSON outputs from an LLM and compute precision, recall, and F1 against ground-truth labels.