< cd ../gallery
Python SDK for Agent Vector Protocol – transfer KV-cache between LLM agents instead of text. Maintained by VectorArc on GitHub, where it has earned 25 stars from the community.
more vLLM repos
AI & ML
Benchmark OpenAI-compatible AI endpoints and AI Accelerators in a reproducible structured way. Maintained by flexaihq on GitHub, where it has earned 12 stars from the community.
7mo ago
AI & ML
nano-vllmmoeSpeculative Decoding. Maintained by banfeb on GitHub, where it has earned 11 stars from the community.
4mo ago
AI & ML
High-Performance KV Cache Storage Engine on CXL Shared Memory for LLM Inference. Maintained by xcena-dev on GitHub, where it has earned 56 stars from the community.
2mo ago
