GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index. Maintained by zilliztech on GitHub, where it has earned 8,097 stars from the community.

It's actively developed around aigc, autogpt, babyagi, and is a solid reference for anyone building with these tools.