Mohit-jpg-dot/AirDrop-LLM

An offline, zero-dependency multi-node pipeline-parallel LLM inference broker. Pools heterogeneous consumer hardware (Apple Metal + NVIDIA CUDA) over ad-hoc local hotspot LANs with an integrated OpenAI-compatible API gateway.

语言：Rust · GitHub 星标：9 · Fork：0

话题：distributed-systems · llm-inference · offline-ai · openai-api · p2p-networking · pipeline-parallelism · rust · systems-programming

在 GitHub 上查看原仓库