qiuzh20/gated_attention

The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free

语言：Jupyter Notebook · GitHub 星标：991 · Fork：61

在 GitHub 上查看原仓库