llamactl by lordmathis

An Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang performance. Maintained by matrixhub-ai on GitHub, where it has earned 258 stars from the community.

Easy, advanced inference platform for large language models on Kubernetes. Star to support our work!. Maintained by InftyAI on GitHub, where it has earned 308 stars from the community.

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends. Maintained by thushan on GitHub, where it has earned 273 stars from the community.