maidacundo/MoE-LoRA

Adapt an LLM model to a Mixture-of-Experts model using Parameter Efficient finetuning (LoRA), injecting the LoRAs in the FFN.

语言：Python · GitHub 星标：94 · Fork：4

在 GitHub 上查看原仓库