lucidrains/rela-transformer

Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012

语言：Python · GitHub 星标：49 · Fork：6

在 GitHub 上查看原仓库