AviSoori1x/makeMoE

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

语言：Jupyter Notebook · GitHub 星标：820 · Fork：96

话题：deep-learning · large-language-models · llm · mixture-of-experts · neural-networks · pytorch · pytorch-implementation

在 GitHub 上查看原仓库