arks

Arks is a cloud-native inference framework running on Kubernetes. Maintained by scitix on GitHub, where it has earned 50 stars from the community.

It's actively developed around cloudnative-services, dynamo, kubernetes, and is a solid reference for anyone building with these tools.