aws-samples/sample-genai-on-eks-starter-kit

A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: 🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama) 📊 Vector Databases, 🔍 Embedding Models (TEI) 📈 Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes

语言：JavaScript · GitHub 星标：98 · Fork：62

话题：agentic-ai · ai-agents · ai-engineering · ai-gateway · ai-platform · amazon-eks · aws · generative-ai

在 GitHub 上查看原仓库