< cd ../gallery
[AI & ML]
kserve
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
@kserve
maintainer
★ 5.7k stars
# README
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes. Maintained by kserve on GitHub, where it has earned 5,681 stars from the community.
It's actively developed around artificial-intelligence, cncf, genai, and is a solid reference for anyone building with these tools.
# tags
# install
npm install kservelanguages
Go64.496%
Python30.025%
Shell3.722%
Dockerfile0.667%
Go Template0.553%
Makefile0.537%
Procfile0%
last commit1 week ago
licenseApache-2.0
more vLLM repos
