tonyd2wild/Deepseek-v4-Flash-TP2-DGX-Spark-500k-CTX

Working recipe to serve DeepSeek-V4-Flash across two NVIDIA DGX Spark (GB10) nodes with vLLM (TP=2, FP8 KV, MTP) over a RoCE/RDMA link — Docker image, launch scripts, RDMA/NCCL setup, and the gotchas.

语言：Shell · GitHub 星标：85 · Fork：13

在 GitHub 上查看原仓库