< cd ../gallery
[AI & ML]
ome
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
@ome-projects
maintainer
★ 485 stars
# README
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton. Maintained by ome-projects on GitHub, where it has earned 485 stars from the community.
It's actively developed around k8s, llm-inference, model-as-a-service, and is a solid reference for anyone building with these tools.
# tags
# install
npm install omemore vLLM repos
