nektarlabs/inferno

Inferno aims to be a super lightweight, highly efficient Rust inference engine for running open weights models on Apple Silicon with Metal, targeting machines such as a MacBook Pro with 64 GB of unified memory.

语言：Rust · GitHub 星标：45 · Fork：5

在 GitHub 上查看原仓库