< cd ../gallery
[AI & ML]
ramalama by containers
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers. Maintained by containers on GitHub, where it has earned 2,987 stars from the community.
# install
pip install ramalamamore vLLM repos
AI & ML
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer. Maintained by LMCache on GitHub, where it has earned 11,024 stars from the community.
2mo ago
AI & ML
Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | — Kimi K2.7-Code、MiniMax M3、DeepSeekv4、GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72，™ TPUv6e/v7/Trainium2/3. Maintained by SemiAnalysisAI on GitHub, where it has earned 1,318 stars from the community.
2mo ago
AI & ML
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances. Maintained by gpustack on GitHub, where it has earned 5,436 stars from the community.
2mo ago
