agentops

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI. Maintained by AgentOps-AI on GitHub, where it has earned 5,707 stars from the community.

It's actively developed around agent, agentops, agents-sdk, and is a solid reference for anyone building with these tools.