nano-vLLM-MS2

nano-vllmmoeSpeculative Decoding. Maintained by banfeb on GitHub, where it has earned 11 stars from the community.

It's actively developed around inference, llm, moe, and is a solid reference for anyone building with these tools.