haru

GPU orchestrator with vLLM sleep mode. Maintained by arkorlab on GitHub, where it has earned 11 stars from the community.

It's actively developed around fine-tuning, gpu, vllm, and is a solid reference for anyone building with these tools.