rwilliamspbg-ops/Ghostlink

Distributed LLM inference fabric for heterogeneous local clusters. Features zero-copy SPSC ring buffers, automated tuning, and an OpenAI-compatible API.

语言：Rust · GitHub 星标：84 · Fork：12

话题：af-xdp · computer-networks · deep-learning · distributed-computing · gpu-computing · inference · llm · networking-concepts

在 GitHub 上查看原仓库