Back to projects
AI & ML
ome
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
ome-projects
Maintainer
485 stars
About this project
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton. Maintained by ome-projects on GitHub, where it has earned 485 stars from the community.
It's actively developed around k8s, llm-inference, model-as-a-service, and is a solid reference for anyone building with these tools.
Tags
Install
npm install omeMore Gin projects
