IPADS-SAI/Mobiinfer-Android

MobiInfer runs 35B-A3B-class MoE models fully on-device on the Qualcomm Hexagon NPU, streaming experts from flash with lookahead scheduling (LES) and DSpark speculation.

语言：C++ · GitHub 星标：194 · Fork：24

在 GitHub 上查看原仓库