kubeai

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text. Maintained by kubeai-project on GitHub, where it has earned 1,222 stars from the community.

It's actively developed around ai, autoscaler, faster-whisper, and is a solid reference for anyone building with these tools.