Guitaricet/relora

Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates

语言：Jupyter Notebook · GitHub 星标：477 · Fork：42

话题：deep-learning · distributed-training · llama · nlp · peft · transformer

在 GitHub 上查看原仓库