jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

语言：Python · GitHub 星标：23,373 · Fork：2,094

话题：apple-silicon · inference-server · llm · macos · mlx · openai-api

在 GitHub 上查看原仓库