LeaderWorkerSet & DisaggregatedSet: Kubernetes APIs for Distributed and Disaggregated AI Serving
语言:Go · GitHub 星标:897 · Fork:202
话题:llm-inference · sig-apps
在 GitHub 上查看原仓库