< cd ../gallery
Easily boost the speed of pulling your models and datasets from various of inference runtimes. (e.g. HuggingFace, Ollama, vLLM, and more!). Maintained by moeru-ai on GitHub, where it has earned 15 stars from the community.
# install
go get github.com/moeru-ai/demodelmore vLLM repos
AI & ML
Easy, advanced inference platform for large language models on Kubernetes. Star to support our work!. Maintained by InftyAI on GitHub, where it has earned 308 stars from the community.
11mo ago
AI & ML
Kubernetes-native control plane for scale-to-zero serving of long-tail LLMs. Maintained by noctaya on GitHub, where it has earned 11 stars from the community.
8w ago
AI & ML
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends. Maintained by thushan on GitHub, where it has earned 273 stars from the community.
8w ago
