helicone by Helicone

Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. YC W23. Maintained by langfuse on GitHub, where it has earned 32,533 stars from the community.

Turn any webpage into structured data using LLMs. Maintained by mishushakov on GitHub, where it has earned 6,895 stars from the community.

Langtrace is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python.. Maintained by Scale3-Labs on GitHub, where it has earned 1,225 stars from the community.