vllm-cn

vllm. Maintained by gameofdimension on GitHub, where it has earned 31 stars from the community.

It's actively developed around vllm, and is a solid reference for anyone building with these tools.