noctaya

Kubernetes-native control plane for scale-to-zero serving of long-tail LLMs. Maintained by noctaya on GitHub, where it has earned 11 stars from the community.

It's actively developed around ascend, keda, kubernetes, and is a solid reference for anyone building with these tools.