< cd ../gallery
[AI & ML]

maru

High-Performance KV Cache Storage Engine on CXL Shared Memory for LLM Inference
xcena-dev
@xcena-dev
maintainer
★ 56 stars
go to website ↗github
maru — preview
maru repository preview
# README
High-Performance KV Cache Storage Engine on CXL Shared Memory for LLM Inference. Maintained by xcena-dev on GitHub, where it has earned 56 stars from the community.
It's actively developed around cxl, kv-cache, llm, and is a solid reference for anyone building with these tools.
# tags
# install
npm install maru
languages
C++12%
C0%
last commit5w ago
licenseApache-2.0
more vLLM repos

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.