< cd ../gallery
[AI & ML]
vCache
Reliable and Efficient Semantic Prompt Caching with vCache
@vcache-project
maintainer
★ 76 stars
# README
Reliable and Efficient Semantic Prompt Caching with vCache. Maintained by vcache-project on GitHub, where it has earned 76 stars from the community.
It's actively developed around chatbot, consistency, correctness, and is a solid reference for anyone building with these tools.
# tags
# install
npm install vCachemore vLLM repos
