wombatkv

Object-storage-native KV cache for LLM inference & RL. Cross-restart, cross-conversation, cross-engine via shared S3 bucket. Maintained by Venkat2811 on GitHub, where it has earned 18 stars from the community.

It's actively developed around amd, caching, ds4, and is a solid reference for anyone building with these tools.