Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI. Maintained by kvcache-ai on GitHub, where it has earned 5,816 stars from the community.

It's actively developed around disaggregation, inference, kvcache, and is a solid reference for anyone building with these tools.