sample-genai-on-eks-starter-kit

A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: AI Gateway (LiteLLM) LLM Serving (vLLM, SGLang, Ollama) Vector Databases, Embedding Models (TEI) Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes. Maintained by aws-samples on GitHub, where it has earned 91 stars from the community.

It's actively developed around agentic-ai, ai-engineering, ai-platform, and is a solid reference for anyone building with these tools.