Langfuse

https://langfuse.com/

Langfuse is the open source LLM Engineering Platform. It provides observability, metrics, evals, prompt management and a playground to debug and improve LLM apps.

Features:

• Observability: Monitor and understand the behavior of your LLM applications in real-time.
• Metrics: Track and analyze key performance indicators to optimize your models.
• Evaluations: Conduct comprehensive evaluations to assess the quality and effectiveness of your models.
• Prompt Management: Manage and organize prompts for consistent and efficient use.
• Playground: A sandbox environment to experiment, debug, and improve your LLM applications.
• Open APIs: Build downstream use cases with flexible and open APIs.