kibotu/llm-windows-server

Turn your Windows GPU into a private, low-latency LLM server. Docker-based, OpenAI-compatible API.

语言：PowerShell · GitHub 星标：7 · Fork：1

话题：agentic · cuda · docker · gguf · llma-cpp · local-llm · nvidia-gpu · openai-api

在 GitHub 上查看原仓库