< cd ../gallery
[AI & ML]
worker-vllm by runpod-workers
The Runpod worker template for serving our large language model endpoints. Powered by vLLM. Maintained by runpod-workers on GitHub, where it has earned 461 stars from the community.
# install
pip install worker-vllmmore vLLM repos
AI & ML
Official implementation for Text Generation Beyond Discrete Token Sampling. Maintained by EvanZhuang on GitHub, where it has earned 26 stars from the community.
1y ago
AI & ML
Python package for LLM compression. Maintained by FujitsuResearch on GitHub, where it has earned 398 stars from the community.
2mo ago
AI & ML
An endpoint server for efficiently serving quantized open-source LLMs for code. Maintained by wangcx18 on GitHub, where it has earned 59 stars from the community.
2y ago
