modelship

Self-hosted, OpenAI-compatible inference for the agentic era: reasoning LLMs, universal tool calling, and the Responses API alongside embeddings, speech, and image models — many models sharing your GPUs, one gateway. Powered by Ray Serve. Maintained by modelship-ai on GitHub, where it has earned 37 stars from the community.

It's actively developed around diffusers, embeddings, image-generation, and is a solid reference for anyone building with these tools.