Agents
5 agents available in the Gemini directory
agent-benchmarkAgentBench-Live
The open benchmark for AI agent task execution. Claude Code vs Gemini CLI — who wins? Live leaderboard inside.
J
jackjin1997 4
aisynkro
AI agent simulation framework
V
velocitybolt 67
agentSciEvalKit
A unified evaluation toolkit and leaderboard for rigorously assessing the scientific intelligence of large language and vision–language models across the full research workflow.
I
InternScience 79
agent-evaluationteamcity-ai-agent-testing-demo
End-to-end TeamCity framework to run AI agents on SWE-Bench Lite. Spin up isolated Docker images per task, extract patches, score with the official harness, and aggregate success rates. As an example, we'll look at Junie and Google Gemini CLI
J
JetBrains 5
cipromptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
P
promptfoo 20,133