**GEPA**
Free
About **GEPA**
GEPA (Genetic-Pareto) is an open-source framework for optimizing any system with textual parameters against any evaluation metric. Unlike RL or gradient-based methods that collapse execution traces into a single scalar reward, GEPA uses LLMs to read full execution traces—including error messages, profiling data, and reasoning logs—to diagnose why a candidate failed and propose targeted fixes. Through iterative reflection, mutation, and Pareto-aware selection, GEPA evolves high-performing variants with minimal evaluations. It has demonstrated 90x cost savings compared to proprietary models, 35x faster optimization than RL, and accuracy improvements from 32% to 89% on tasks such as prompt optimization (e.g., AIME benchmark), agent architecture discovery (ARC-AGI), cloud scheduling policy optimization, and coding agent skill learning. GEPA is used in production by companies including Shopify, Databricks, Dropbox, OpenAI, Pydantic, MLflow, and Comet ML.
Key Features
Pros & Cons
- Highly cost-effective: 90x cheaper than using proprietary models for comparable quality
- Fast convergence: requires only 100–500 evaluations vs. 5,000–25,000+ for RL
- Open-source and free to use (MIT license)
- Proven in production by major companies (Shopify, Databricks, Dropbox, OpenAI)
- Easy to install (pip) and integrate with existing workflows (e.g., DSPy)
- Self-diagnostic: uses LLMs to read execution traces and propose informed improvements
- Active community with extensive documentation, examples, and a research paper
- Requires access to LLMs for the reflection step, incurring API costs or need for local LLM hosting
- Optimization relies on a measurable metric; defining a good metric is essential
- May require careful tuning of mutation and selection parameters for optimal results
- Currently focused on textual parameters; not suited for optimizing numeric or non-textual systems directly