GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index. Maintained by zilliztech on GitHub, where it has earned 8,122 stars from the community.

It's actively developed around chatbot, chatgpt, chatgpt-api, and is a solid reference for anyone building with these tools.