openagent-eval

Local-first evaluation framework for RAG systems and AI Agents. 18+ metrics, CLI + SDK, framework-agnostic. The pytest of AI evaluation. Maintained by OpenAgentHQ on GitHub, where it has earned 13 stars from the community.

It's actively developed around rag, rag-evaluation, cli, and is a solid reference for anyone building with these tools.