Helicone
Self-host / Cloud
About
Self-host / Cloud Found in: Yigtwxx/Awesome-RAG-Production
Details
Helicone is an open-source LLM observability platform that provides an AI Gateway for accessing 100+ AI models through a single API key. It enables monitoring, evaluating, and experimenting with LLM applications with one line of code. Key capabilities include intelligent routing and automatic fallbacks, detailed request logging and tracing for agents and chatbots, cost and latency analytics, a playground for prompt testing, version-controlled prompt management, and fine-tuning integration with partners like OpenPipe and Autonomi. It is SOC 2 and GDPR compliant, offers a generous monthly free tier (10k requests/month), and can be self-hosted or used as a cloud service. Helicone is Y Combinator W23.