< cd ../gallery
[AI & ML]
kubeai by kubeai-project
AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text. Maintained by kubeai-project on GitHub, where it has earned 1,238 stars from the community.
# install
pip install kubeaimore vLLM repos
AI & ML
Easy, advanced inference platform for large language models on Kubernetes. Star to support our work!. Maintained by InftyAI on GitHub, where it has earned 308 stars from the community.
11mo ago
AI & ML
Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs. Maintained by llmariner on GitHub, where it has earned 94 stars from the community.
5mo ago
AI & ML
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton. Maintained by ome-projects on GitHub, where it has earned 485 stars from the community.
2mo ago
