helicone

Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23. Maintained by Helicone on GitHub, where it has earned 5,944 stars from the community.

It's actively developed around agent-monitoring, analytics, evaluation, and is a solid reference for anyone building with these tools.