helicone

Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23. Maintained by Helicone on GitHub, where it has earned 6,034 stars from the community.

It's actively developed around large-language-models, prompt-engineering, agent-monitoring, and is a solid reference for anyone building with these tools.