Openllmetry

Open-source observability for your LLM application, based on OpenTelemetry Found in: kyrolabs/awesome-langchain

OpenLLMetry is an open-source observability tool for GenAI and LLM applications, built on top of OpenTelemetry. It provides complete tracing and monitoring by instrumenting LLM providers (OpenAI, Anthropic, Cohere, etc.), vector databases (Chroma, Pinecone, Qdrant, Weaviate, etc.), and frameworks (LangChain, LlamaIndex, Haystack, etc.) as well as standard OpenTelemetry data sources. It uses OpenTelemetry under the hood, allowing it to connect to existing observability stacks such as Datadog, New Relic, Honeycomb, and many others. The project is maintained by Traceloop under the Apache 2.0 license. Getting started is simple: install the Python SDK with 'pip install traceloop-sdk' and initialize with 'Traceloop.init()'.