phoenix by Arize-ai

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. Maintained by comet-ml on GitHub, where it has earned 21,117 stars from the community.

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs. Maintained by openlit on GitHub, where it has earned 2,669 stars from the community.

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data. Maintained by mlflow on GitHub, where it has earned 27,368 stars from the community.