< cd ../gallery
[AI & ML]
mlx-openai-server
A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.
@cubist38
maintainer
★ 351 stars
# README
A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface. Maintained by cubist38 on GitHub, where it has earned 351 stars from the community.
It's actively developed around apple-silicon, continuous-batching, fastapi, and is a solid reference for anyone building with these tools.
# tags
# install
npm install mlx-openai-servermore FastAPI repos
