redaER7/qwen3.8-27b-self-hosted

Self-hosted Qwen3.8-27B (FP8) inference with vLLM, KServe and Envoy AI Gateway on RTX 6000 PRo or 2× RTX 4080 Super

语言：Shell · GitHub 星标：18 · Fork：2

话题：envoy-ai-gateway · gpu-inference · kserve · qwen3-8 · self-hosted-llm

在 GitHub 上查看原仓库