< cd ../gallery
[AI & ML]
cascade
Extend LLM context windows beyond GPU memory limits with disk-backed KV cache.
@tirdyhouse
maintainer
★ 11 stars
# README
Extend LLM context windows beyond GPU memory limits with disk-backed KV cache. Maintained by tirdyhouse on GitHub, where it has earned 11 stars from the community.
It's actively developed around ai, cache, deepseek, and is a solid reference for anyone building with these tools.
# tags
# install
npm install cascademore vLLM repos
