sebytzr16/on-device-llm

Private, offline AI assistant for Android and Windows: run local LLMs (Gemma 4, Qwen, any GGUF) on your phone or PC with llama.cpp, CUDA and Vulkan. Voice, documents, photos, cited web research. No account, no cloud.

语言：Dart · GitHub 星标：12 · Fork：2

话题：ai-assistant · android · chatgpt-alternative · cuda · flutter · gemma · gguf · llama-cpp

在 GitHub 上查看原仓库