CASE-Lab-UMD/LLM-Drop

The official implementation of the paper "Uncovering the Redundancy in Transformers via a Unified Study of Layer Dropping (TMLR)".

语言：Python · GitHub 星标：193 · Fork：23

话题：attention-mechanism · deep-learning · large-language-models · machine-learning · model-compression · natural-language-processing

在 GitHub 上查看原仓库