gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances. Maintained by gpustack on GitHub, where it has earned 5,317 stars from the community.

It's actively developed around ascend, cuda, deepseek, and is a solid reference for anyone building with these tools.