< cd ../gallery
[AI & ML]
distributed-inference-vllm
Distributed Inference with vLLM
@KempnerInstitute
maintainer
★ 12 stars
# README
Distributed Inference with vLLM. Maintained by KempnerInstitute on GitHub, where it has earned 12 stars from the community.
It's actively developed around hpc, llama3, qwen2-5, and is a solid reference for anyone building with these tools.
# tags
# install
npm install distributed-inference-vllmmore vLLM repos
