seuros/MDMA

Model Dispatch and Memory Allocator: an LLM inference engine for the hardware you own. Custom CPU, ROCm, Vulkan, CUDA, Metal and Level Zero kernels, exact memory admission, mTLS gRPC and private federation.

语言：Rust · GitHub 星标：18 · Fork：4

话题：amd · apple-silicon · cuda · federation · freebsd · gguf · gpu · grpc

在 GitHub 上查看原仓库