mlx-openai-server

A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface. Maintained by cubist38 on GitHub, where it has earned 351 stars from the community.

It's actively developed around apple-silicon, continuous-batching, fastapi, and is a solid reference for anyone building with these tools.