Chleba/ollamaMQ

High-performance LLM backends proxy with per-user fair-share queuing, round-robin scheduling, and a real-time TUI dashboard. Built in Rust.

语言：Rust · GitHub 星标：130 · Fork：16

话题：fair-share · llm-ops · message-queue · ollama · openai-compatible · proxy · rust · tui

在 GitHub 上查看原仓库