< cd ../gallery
[AI & ML]
CacheRoute by AstraNetLab
CacheRoute is an innovative LLM scheduling scheme dedicated to enabling flexible KV cache reuse across LLM systems, improving task performance and system efficiency. Maintained by AstraNetLab on GitHub, where it has earned 293 stars from the community.
# install
pip install cacheroutemore FastAPI repos
AI & ML
SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35B-A3B FP8 ~240 tok/s, 27B-int4 hybrid GDN+Mamba, Gemma4 26B/31B AWQ, 256K ctx. 321 patches: TurboQuant k8v4 KV, MTP/DFlash spec-decode, FULL cudagraph, hybrid GDN. vLLM pin dev424 + Control Center GUI. Maintained by Sandermage on GitHub, where it has earned 131 stars from the community.
2mo ago
AI & ML
Drop-in prompt compression for production LLM apps. Cut your token bill 40-60% without changing your code. Python SDK, LLMLingua-2, MIT. Maintained by jia-gao on GitHub, where it has earned 316 stars from the community.
8w ago
AI & ML
Organization-as-Code for autonomous AI agents. Brain-inspired memory that grows, consolidates, and forgets. Multi-model (Claude/Codex/Gemini/Cursor/Ollama). Maintained by xuiltul on GitHub, where it has earned 253 stars from the community.
8w ago
