thu-pacman/chitu

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

语言：Python · GitHub 星标：2,996 · Fork：249

话题：deepseek · gpu · llm · llm-serving · model-serving · pytorch

在 GitHub 上查看原仓库