< cd ../gallery
[AI & ML]
mvllm
Intelligent load balancer for distributed vLLM server clusters vLLM
@xerrors
maintainer
★ 19 stars
# README
Intelligent load balancer for distributed vLLM server clusters vLLM. Maintained by xerrors on GitHub, where it has earned 19 stars from the community.
It's actively developed around balancer, inference, llms, and is a solid reference for anyone building with these tools.
# tags
# install
npm install mvllmmore vLLM repos
