maru by xcena-dev

This project aims to provide a high effective KV cache manage framework for llm inference and improve memory utilization and inference speed. Maintained by TheToughCrane on GitHub, where it has earned 71 stars from the community.

Python SDK for Agent Vector Protocol – transfer KV-cache between LLM agents instead of text. Maintained by VectorArc on GitHub, where it has earned 25 stars from the community.

Official implementation for Text Generation Beyond Discrete Token Sampling. Maintained by EvanZhuang on GitHub, where it has earned 26 stars from the community.