< cd ../gallery
[AI & ML]
Rapid-MLX by raullenchai
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider. Maintained by raullenchai on GitHub, where it has earned 3,400 stars from the community.
# install
pip install rapid-mlxmore vLLM repos
AI & ML
OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool calling, and multimodal support. Native MLX backend, 400+ tok/s. Works with Claude Code. Maintained by waybarrios on GitHub, where it has earned 1,488 stars from the community.
2mo ago
AI & ML
Accurate, large-scale, and extensible simulator for LLM inference Systems. Maintained by microsoft on GitHub, where it has earned 654 stars from the community.
1y ago
AI & ML
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle. Maintained by PaddlePaddle on GitHub, where it has earned 3,703 stars from the community.
2mo ago
