< cd ../gallery
[AI & ML]
KVarN
KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.
@huawei-csl
maintainer
★ 452 stars
# README
KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag. Maintained by huawei-csl on GitHub, where it has earned 452 stars from the community.
It's actively developed around agentic-ai, kv-cache, long-context, and is a solid reference for anyone building with these tools.
# tags
# install
npm install KVarNmore vLLM repos
