< cd ../gallery
[AI & ML]
kvcached
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
@ovg-project
maintainer
★ 1.1k stars
# README
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond. Maintained by ovg-project on GitHub, where it has earned 1,128 stars from the community.
It's actively developed around gpu-sharing, kvcache, llm, and is a solid reference for anyone building with these tools.
# tags
# install
npm install kvcachedmore Ollama repos
