< cd ../gallery
[AI & ML]

vllm-mlx by waybarrios

github
OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool calling, and multimodal support. Native MLX backend, 400+ tok/s. Works with Claude Code. Maintained by waybarrios on GitHub, where it has earned 1,488 stars from the community.
waybarrios
@waybarrios
maintainer
★ 1.5k stars
197 forks
13 watchers

# install

pip install vllm-mlx

languages

Python100%
last commit2mo ago
licenseApache-2.0

more FastAPI repos

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.