< cd ../gallery
[AI & ML]
vCache
Reliable and Efficient Semantic Prompt Caching with vCache
@vcache-project
maintainer
★ 75 stars
# README
Reliable and Efficient Semantic Prompt Caching with vCache. Maintained by vcache-project on GitHub, where it has earned 75 stars from the community.
It's actively developed around cache, chatbot, consistency, and is a solid reference for anyone building with these tools.
# tags
# install
npm install vCachemore vLLM repos