vCache

Reliable and Efficient Semantic Prompt Caching with vCache. Maintained by vcache-project on GitHub, where it has earned 75 stars from the community.

It's actively developed around cache, chatbot, consistency, and is a solid reference for anyone building with these tools.