GitHub
FreeMulti-Agent Language Game Environments for LLMs
FreeFree tier
Inputs: textOutputs: text
About GitHub
ChatArena is an open-source Python library for building multi-agent language game environments to facilitate research on autonomous LLM agents and their social interactions. It provides an abstraction framework based on Markov Decision Process to define players, environments, and interactions, along with a set of pre-built environments for benchmarking and training LLMs. The tool includes both a web UI (Gradio-based) and a CLI for easy development and prompt engineering. Supports multiple LLM backends including OpenAI GPT, Anthropic, Cohere, and Hugging Face models. Note: The project was deprecated in August 2025 due to limited community use.
Key Features
Abstraction framework based on Markov Decision Process for defining players, environments, and interactions
Set of pre-built language game environments for benchmarking and training LLMs
User-friendly Web UI (Gradio) and CLI for development and prompt engineering
Support for multiple LLM backends: OpenAI GPT, Anthropic, Cohere, Hugging Face, etc.
Modular architecture allowing custom environment creation and player configuration
Pros & Cons
Pros
- Open-source and freely available with permissive license
- Provides both Web UI and CLI for flexible usage
- Modular and extensible framework supports custom environments and players
- Supports integration with multiple popular LLM providers
- Well-documented with guides for developers and example environments
Cons
- Project is now deprecated with no future updates or support (as of Aug 2025)
- Limited community adoption led to deprecation
- Requires manual setup of API keys for proprietary LLMs
- Documentation and examples may become outdated over time
Best For
Research on multi-agent communication and collaboration capabilities of AIBenchmarking and evaluating LLMs in structured social interaction scenariosTraining and prompt engineering for autonomous LLM agents in game-like settingsEducational demonstrations of multi-agent LLM behavior
FAQ
How do I install ChatArena?
ChatArena can be installed via pip with `pip install chatarena` or from source with `pip install git+https://github.com/chatarena/chatarena`. Python 3.7+ is required.
What LLM backends does ChatArena support?
ChatArena supports multiple backends including OpenAI GPT-3.5-turbo, GPT-4, Anthropic, Cohere, and Hugging Face models. Optional dependencies can be installed for all backends via `pip install chatarena[all_backends]`.
Is there a demo I can try without installing?
Yes, an online demo is available, though the exact URL is not provided in the documentation. You can also run the demo locally using `gradio app.py` after installing with Gradio support.
Is ChatArena still maintained?
No, as of August 11, 2025, the project has been deprecated due to lack of widespread community use and is no longer planned to receive updates or support.