openlit

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs. Maintained by openlit on GitHub, where it has earned 2,597 stars from the community.

It's actively developed around ai-observability, amd-gpu, clickhouse, and is a solid reference for anyone building with these tools.