< cd ../gallery

[AI & ML]

modelship by modelship-ai

go to website ↗github

Self-hosted, OpenAI-compatible inference for the agentic era: reasoning LLMs, universal tool calling, and the Responses API alongside embeddings, speech, and image models — many models sharing your GPUs, one gateway. Powered by Ray Serve. Maintained by modelship-ai on GitHub, where it has earned 37 stars from the community.

maintainer

★ 37 stars

4 forks

# install

pip install modelship

# tags

Python Diffusers Embeddings Image Generation Llm

languages

last commit2mo ago

licenseApache-2.0

latest versions

v0.7.8↗v0.7.7↗v0.7.6↗v0.7.5↗v0.7.4↗

more vLLM repos

Official implementation for Text Generation Beyond Discrete Token Sampling. Maintained by EvanZhuang on GitHub, where it has earned 26 stars from the community.

@EvanZhuang1y ago

[CVPR2025] Official Repository for IMMUNE: Improving Safety Against Jailbreaks in Multi-modal LLMs via Inference-Time Alignment. Maintained by itsvaibhav01 on GitHub, where it has earned 29 stars from the community.

@itsvaibhav011y ago

A REST API for vLLM, production ready. Maintained by France-Travail on GitHub, where it has earned 29 stars from the community.

@France-Travail12mo ago