< cd ../gallery
[AI & ML]
llmaz by InftyAI
Easy, advanced inference platform for large language models on Kubernetes. Star to support our work!. Maintained by InftyAI on GitHub, where it has earned 308 stars from the community.
# install
pip install llmazmore vLLM repos
AI & ML
Arks is a cloud-native inference framework running on Kubernetes. Maintained by scitix on GitHub, where it has earned 50 stars from the community.
5mo ago
AI & ML
An Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang performance. Maintained by matrixhub-ai on GitHub, where it has earned 258 stars from the community.
2mo ago
AI & ML
Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs. Maintained by llmariner on GitHub, where it has earned 94 stars from the community.
5mo ago
