< cd ../gallery
[AI & ML]
ome by ome-projects
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton. Maintained by ome-projects on GitHub, where it has earned 485 stars from the community.
# install
go get github.com/ome-projects/omemore vLLM repos
AI & ML
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends. Maintained by thushan on GitHub, where it has earned 273 stars from the community.
8w ago
AI & ML
Easy, advanced inference platform for large language models on Kubernetes. Star to support our work!. Maintained by InftyAI on GitHub, where it has earned 308 stars from the community.
11mo ago
AI & ML
An Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang performance. Maintained by matrixhub-ai on GitHub, where it has earned 258 stars from the community.
2mo ago
