leva

LLM Evaluation Framework for Rails apps to be used with production data. Maintained by kieranklaassen on GitHub, where it has earned 142 stars from the community.

It's actively developed around llm, llm-evaluation, ruby-on-rails, and is a solid reference for anyone building with these tools.