kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond. Maintained by ovg-project on GitHub, where it has earned 1,097 stars from the community.

It's actively developed around elastic-kvcache, gpu-mutiplexing, gpu-sharing, and is a solid reference for anyone building with these tools.