< cd ../gallery
[AI & ML]
nano-vllm-v1
Nano vLLM with vLLM v1's request scheduling strategy and chunked prefill
@slwang-ustc
maintainer
★ 92 stars
# README
Nano vLLM with vLLM v1's request scheduling strategy and chunked prefill. Maintained by slwang-ustc on GitHub, where it has earned 92 stars from the community.
It's actively developed around deep-learning, inference, llm, and is a solid reference for anyone building with these tools.
# tags
# install
npm install nano-vllm-v1more vLLM repos
