Back to projects
AI & ML
ome by ome-projects
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton. Maintained by ome-projects on GitHub, where it has earned 485 stars from the community.
Install
go get github.com/ome-projects/omeMore Gin projects
AI & ML
An Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang performance. Maintained by matrixhub-ai on GitHub, where it has earned 258 stars from the community.
M
2mo agoAI & ML
A highly efficient, secure, and stable application development platform with excellent performance, easy scalability, and deep integration of AI capabilities such as LLM, AI Chat, RAG, and Agents.、、，，，LLM、AIChat、RAG、AgentAI. Maintained by liaotxcn on GitHub, where it has earned 425 stars from the community.
L
3mo agoAI & ML
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc. Maintained by mostlygeek on GitHub, where it has earned 5,268 stars from the community.
M
2mo ago