< cd ../gallery
[AI & ML]
nano-vllm-v1
Nano vLLM with vLLM v1's request scheduling strategy and chunked prefill
@slwang-ustc
maintainer
★ 95 stars
# README
Nano vLLM with vLLM v1's request scheduling strategy and chunked prefill. Maintained by slwang-ustc on GitHub, where it has earned 95 stars from the community.
It's actively developed around llm, llm-inference, deep-learning, and is a solid reference for anyone building with these tools.
# tags
# install
npm install nano-vllm-v1more vLLM repos
