turboquant-vllm

TurboQuant KV cache compression plugin for vLLM — asymmetric K/V, 8 models validated, consumer GPUs. Maintained by Alberto-Codes on GitHub, where it has earned 48 stars from the community.

It's actively developed around compression, consumer-gpu, inference-optimization, and is a solid reference for anyone building with these tools.