AIQualityHQ
Automated QA & Security Guardrails for Prompts and AI Agents
AIQualityHQ provides automated quality assurance and security guardrails for prompts and AI agents. It offers tools for detecting defects, optimizing token costs, and ensuring prompt security through a browser-native platform.
Patronus AI
Automated AI evaluation and red-teaming platform
Patronus AI provides automated evaluation and red-teaming for LLM applications. It detects hallucinations, toxicity, PII leaks, and other failure modes with enterprise-grade evaluation infrastructure.
Lakera Guard
Lakera secures GenAI apps and agents in real time—ultra-low latency, precision, and protection powered by the world’s largest AI red team.
Lakera is an AI-native security platform that protects Generative AI applications, agents, and MCPs with real-time runtime protection, AI red teaming, and centralized policy control. Backed by the world’s largest AI red team (Gandalf) and trusted by Fortune 500 companies like Dropbox, Lakera delivers sub-50 ms latency, a 0.01% false positive rate, multimodal/model-agnostic coverage across 100+ languages, and effortless scale to 1M+ transactions per app/day. Founded in 2021 (Zurich and San Francisco), recognized by Gartner and OWASP, and acquired by Check Point in 2025, Lakera reduces AI risks by 3–4 orders of magnitude and adapts to evolving threats without code changes.
Guardrails.ai
A Python library for validating outputs and retrying failures. Still in alpha, so expect sharp edges and bugs.
A Python library for validating outputs and retrying failures. Still in alpha, so expect sharp edges and bugs. Found in: Hannibal046/Awesome-LLM
Galileo AI
AI evaluation platform for hallucination detection and quality
Galileo provides AI evaluation tools that detect hallucinations, measure response quality, and monitor LLM application performance. It offers real-time guardrails and automated quality metrics for RAG and agent systems.
NeMo Guardrails
Easily add programmable guardrails to LLM-based conversational systems
Found in: Yigtwxx/Awesome-RAG-Production