CacheRoute

CacheRoute is an innovative LLM scheduling scheme dedicated to enabling flexible KV cache reuse across LLM systems, improving task performance and system efficiency. Maintained by BJTU-ANT on GitHub, where it has earned 157 stars from the community.

It's actively developed around knowledge-injection, kvcache, kvcache-reuse, and is a solid reference for anyone building with these tools.