A Datacenter Scale Distributed Inference Serving Framework
语言:Rust · GitHub 星标:8,446 · Fork:1,825
话题:diffusion · disaggregated-serving · kubernetes · llm-inference · omni · routing-engine · rust · sglang
在 GitHub 上查看原仓库