coloma

The Continuous Verification and Optimization layer for self-hosted LLMs. Maintained by colomalabs on GitHub, where it has earned 12 stars from the community.

It's actively developed around llm-inference, mlops, self-hosted, and is a solid reference for anyone building with these tools.