fiddler-auditor

Fiddler Auditor is a tool to evaluate language models. Maintained by fiddler-labs on GitHub, where it has earned 194 stars from the community.

It's actively developed around ai-observability, generative-ai, langchain, and is a solid reference for anyone building with these tools.