infinigence/SpecEE

Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)

语言：C++ · GitHub 星标：75 · Fork：8

在 GitHub 上查看原仓库