< cd ../gallery
[AI & ML]
worker-vllm
The Runpod worker template for serving our large language model endpoints. Powered by vLLM.
@runpod-workers
maintainer
★ 461 stars
# README
The Runpod worker template for serving our large language model endpoints. Powered by vLLM. Maintained by runpod-workers on GitHub, where it has earned 461 stars from the community.
It's actively developed around language-model, llm, runpod, and is a solid reference for anyone building with these tools.
# tags
# install
npm install worker-vllmmore vLLM repos
