< cd ../gallery
[AI & ML]
vllm-mlx
OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool calling, and multimodal support. Native MLX backend, 400+ tok/s. Works with Claude Code.
@waybarrios
maintainer
★ 1.4k stars
# README
OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool calling, and multimodal support. Native MLX backend, 400+ tok/s. Works with Claude Code. Maintained by waybarrios on GitHub, where it has earned 1,428 stars from the community.
It's actively developed around anthropic, apple-silicon, audio-processing, and is a solid reference for anyone building with these tools.
# tags
# install
npm install vllm-mlxmore vLLM repos
