michaelw9999/advanced-gguf-quantizer

A CUDA-accelerated GGUF quantization tool for NVFP4/MXFP6/Q_K, utilizing layer by layer quantization and selection techniques to reduce error.

语言：C++ · GitHub 星标：49 · Fork：7

在 GitHub 上查看原仓库