nano-vllm

a fun and educational take on vLLM. Maintained by ovshake on GitHub, where it has earned 211 stars from the community.

It's actively developed around inference-engine, python, vllm, and is a solid reference for anyone building with these tools.