OpenSparseLLMs/LLaMA-MoE-v2

🚀 LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training

语言：Python · GitHub 星标：93 · Fork：13

话题：attention · fine-tuning · instruction-tuning · llama · llama3 · mixture-of-experts · moe · sft

在 GitHub 上查看原仓库