Thireus/GGUF-Tool-Suite

Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain will create a GGUF recipe tuned to your hardware within seconds — flexible model sizing and lowest achievable perplexity/kld for GGUF enthusiasts seeking precise and automated dynamic quant production.

语言：Shell · GitHub 星标：171 · Fork：19

在 GitHub 上查看原仓库