< cd ../gallery
[AI & ML]
maru
High-Performance KV Cache Storage Engine on CXL Shared Memory for LLM Inference
@xcena-dev
maintainer
★ 55 stars
# README
High-Performance KV Cache Storage Engine on CXL Shared Memory for LLM Inference. Maintained by xcena-dev on GitHub, where it has earned 55 stars from the community.
It's actively developed around cxl, kv-cache, llm, and is a solid reference for anyone building with these tools.
# tags
# install
npm install marumore vLLM repos
