modelship

Self-hosted, OpenAI-compatible inference for the agentic era: reasoning LLMs, universal tool calling, and the Responses API alongside embeddings, speech, and image models — many models sharing your GPUs, one gateway. Powered by Ray Serve. Maintained by alez007 on GitHub, where it has earned 37 stars from the community.

It's actively developed around agentic, diffusers, embeddings, and is a solid reference for anyone building with these tools.