inference-cookbook

inference cookbook / inference. Maintained by SuperMarioYL on GitHub, where it has earned 10 stars from the community.

It's actively developed around vllm, kvcache, sglang, and is a solid reference for anyone building with these tools.