efeslab/Nanoflow

A throughput-oriented high-performance serving framework for LLMs

语言：Jupyter Notebook · GitHub 星标：976 · Fork：55

话题：cuda · inference · llama2 · llm · llm-serving · model-serving

在 GitHub 上查看原仓库