< cd ../gallery
[AI & ML]

sample-genai-on-eks-starter-kit by aws-samples

go to website ↗github
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: AI Gateway (LiteLLM) LLM Serving (vLLM, SGLang, Ollama) Vector Databases, Embedding Models (TEI) Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes. Maintained by aws-samples on GitHub, where it has earned 91 stars from the community.
aws-samples
@aws-samples
maintainer
★ 91 stars
45 forks
3 watchers

# install

pip install sample-genai-on-eks-starter-kit

languages

HCL19%
last commit2mo ago
licenseMIT-0

more vLLM repos

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.