vCache

Reliable and Efficient Semantic Prompt Caching with vCache. Maintained by vcache-project on GitHub, where it has earned 76 stars from the community.

It's actively developed around chatbot, consistency, correctness, and is a solid reference for anyone building with these tools.