Arena
FreeAn open platform for crowdsourced AI benchmarking, hosted by researchers at UC Berkeley SkyLab.
FreeFree tier
Inputs: text, imageOutputs: text, code
About Arena
Arena (formerly LMArena) is a community-powered platform for understanding AI performance in the real world, created by researchers from UC Berkeley. It provides a public leaderboard grounded in real-world human feedback from millions of users. Users can battle AI models, create apps like landing pages, dashboards, games, and full-stack applications, as well as use the 'Design to Code' feature to turn images into code. The platform offers AI evaluation services for enterprises and developers, aiming to measure and advance the frontier of AI for real-world use.
Key Features
LLM Leaderboard and Chat
Battle Mode for direct model comparison
App creation tools (landing pages, dashboards, games, storefronts)
Design to Code: upload an image and have AI build it
Full-stack app generation
Human feedback collection for AI evaluation
Enterprise AI evaluation services
Pros & Cons
Pros
- Community-powered leaderboard reflects real-world performance
- Created by UC Berkeley researchers for transparency
- Supports multiple AI models and diverse tasks
- Free to use
- Offers enterprise evaluation services
Cons
- Privacy: user inputs and conversations are shared publicly and with third-party AI providers
- Responses from third-party AI may be inaccurate or unreliable
- Platform heavily reliant on human feedback, which may introduce bias
Best For
Benchmarking AI models against real-world human preferencesComparing responses from different LLMsRapid prototyping of web apps and games using AICrowdsourced AI evaluation and feedbackEnterprise model assessment and validation
FAQ
What is Arena?
Arena (formerly LMArena) is a community-powered platform for understanding AI performance in the real world, created by researchers from UC Berkeley.
Is Arena free to use?
Yes, Arena appears to be free to use. It is described as an open platform for crowdsourced AI benchmarking.
How are AI models evaluated on Arena?
Models are evaluated through community-powered battles and tasks where users provide feedback on responses, shaping a public leaderboard grounded in real-world use.
Who created Arena?
Arena was created by researchers from UC Berkeley.