benchllm

Continuous Integration for LLM powered applications. Maintained by v7labs on GitHub, where it has earned 259 stars from the community.

It's actively developed around gpt, langchain, llm, and is a solid reference for anyone building with these tools.