< cd ../gallery
[AI & ML]
inference by xorbitsai
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API. Maintained by xorbitsai on GitHub, where it has earned 9,479 stars from the community.
# install
pip install inferencemore vLLM repos
AI & ML
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer. Maintained by LMCache on GitHub, where it has earned 11,024 stars from the community.
2mo ago
AI & ML
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider. Maintained by raullenchai on GitHub, where it has earned 3,400 stars from the community.
2mo ago
AI & ML
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances. Maintained by gpustack on GitHub, where it has earned 5,436 stars from the community.
2mo ago
