cool-japan/oxibonsai

OxiBonsai is a zero-FFI, zero-C/C++ inference engine for PrismML's sub-2-bit Bonsai family — both the 1-bit line (Q1_0_g128) and the ternary line (TQ2_0_g128). It runs on CPU (SIMD), Apple Silicon (Metal), and NVIDIA (CUDA) without depending on llama.cpp, BLAS, or any C/Fortran runtime.

语言：Rust · GitHub 星标：137 · Fork：21

话题：bonsai · pure-rust · qwen3 · rust · rust-crate · rust-lang

在 GitHub 上查看原仓库