CacheRoute

CacheRoute is an innovative LLM scheduling scheme dedicated to enabling flexible KV cache reuse across LLM systems, improving task performance and system efficiency. Maintained by AstraNetLab on GitHub, where it has earned 293 stars from the community.

It's actively developed around knowledge-injection, llm-inference, llm-task-scheduling, and is a solid reference for anyone building with these tools.