Guardrails

Guardrails.ai

A Python library for validating outputs and retrying failures. Still in alpha, so expect sharp edges and bugs. Found in: Hannibal046/Awesome-LLM

NeMo Guardrails

Found in: Yigtwxx/Awesome-RAG-Production

Galileo AI

Galileo provides AI evaluation tools that detect hallucinations, measure response quality, and monitor LLM application performance. It offers real-time guardrails and automated quality metrics for RAG and agent systems.

Lakera Guard

Lakera is an AI-native security platform that protects Generative AI applications, agents, and MCPs with real-time runtime protection, AI red teaming, and centralized policy control. Backed by the world’s largest AI red team (Gandalf) and trusted by Fortune 500 companies like Dropbox, Lakera delivers sub-50 ms latency, a 0.01% false positive rate, multimodal/model-agnostic coverage across 100+ languages, and effortless scale to 1M+ transactions per app/day. Founded in 2021 (Zurich and San Francisco), recognized by Gartner and OWASP, and acquired by Check Point in 2025, Lakera reduces AI risks by 3–4 orders of magnitude and adapts to evolving threats without code changes.

Patronus AI

Patronus AI provides automated evaluation and red-teaming for LLM applications. It detects hallucinations, toxicity, PII leaks, and other failure modes with enterprise-grade evaluation infrastructure.