tayoun/flash-moe

Run a 35B MoE model at 10+ tok/s on a $600 Mac mini. Pure C/Metal inference engine streaming experts from SSD on Apple Silicon

语言：Objective-C · GitHub 星标：21 · Fork：1

在 GitHub 上查看原仓库