xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

语言：Python · GitHub 星标：9,644 · Fork：892

话题：artificial-intelligence · diffusers · gemma · glm · glm-5-3 · inference · kimi · kimi-k3

在 GitHub 上查看原仓库