arks

Arks is a cloud-native inference framework running on Kubernetes. Maintained by scitix on GitHub, where it has earned 51 stars from the community.

It's actively developed around ai, cloudnative-services, dynamo, and is a solid reference for anyone building with these tools.