< cd ../gallery
[AI & ML]
guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks
Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inference. Guidance provides a complete end-to-end platform for deploying LLMs with agentic AI capabilities, including RAG and MCP
@aws-solutions-library-samples
maintainer
★ 19 stars
# README
Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inference. Guidance provides a complete end-to-end platform for deploying LLMs with agentic AI capabilities, including RAG and MCP. Maintained by aws-solutions-library-samples on GitHub, where it has earned 19 stars from the community.
It's actively developed around agentic-ai, agentic-workflow, inference, and is a solid reference for anyone building with these tools.
# tags
# install
npm install guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eksmore vLLM repos
