kserve

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes. Maintained by kserve on GitHub, where it has earned 5,773 stars from the community.

It's actively developed around knative, machine-learning, model-interpretability, and is a solid reference for anyone building with these tools.