noumena-labs/Sipp

AI inference, packed simply. A blazing-fast, zero-dependency WebGPU runtime to run GGUF models directly in the browser. Features a symmetric API for seamless local execution and cloud provider routing. Built with Rust & C++.

语言：Rust · GitHub 星标：123 · Fork：17

话题：ai · cpp · gguf · inference · llamacpp · llm · local-ai · rust

在 GitHub 上查看原仓库