sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

语言：Python · GitHub 星标：38,545 · Fork：10,231

话题：attention · blackwell · cuda · deepseek · diffusion · glm · gpt-oss · inference

在 GitHub 上查看原仓库