< cd ../gallery
[AI & ML]
nexusquant by jagmarques
Training-free KV cache compression via E8 lattice VQ. 2-bit KV that preserves retrieval (30/30 NIAH vs TurboQuant 0/30). Calibration-free, 9 architectures validated. Maintained by jagmarques on GitHub, where it has earned 24 stars from the community.
# install
pip install nexusquantmore vLLM repos
AI & ML
Unified KV-cache compression for LLM inference: 12 Python-native methods, Debian-tested isolated add-ons, Godzilla KVarN/TriAttention, exact Godzilla/Gigatoken profiles, CUDA weight sharing, and multi-GPU planning. Maintained by aivrar on GitHub, where it has earned 25 stars from the community.
2mo ago
AI & ML
First open-source implementation of Google TurboQuant (ICLR 2026) -- near-optimal KV cache compression for LLM inference. 5x compression with near-zero quality loss. Maintained by OnlyTerp on GitHub, where it has earned 78 stars from the community.
4mo ago
AI & ML
TurboQuant KV cache compression plugin for vLLM — asymmetric K/V, 8 models validated, consumer GPUs. Maintained by Alberto-Codes on GitHub, where it has earned 48 stars from the community.
6mo ago
