mostlygeek/llama-swap

Reliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don't need it.

语言：Go · GitHub 星标：6,176 · Fork：538

话题：golang · llama · llamacpp · localllama · localllm · openai · openai-api · vllm

在 GitHub 上查看原仓库