AmesianX/TurboQuant

TurboQuant KV Cache Compression for llama.cpp — 5.2x memory reduction with near-lossless quality | Implementation of Google DeepMind's TurboQuant (ICLR 2026)

语言：C++ · GitHub 星标：92 · Fork：16

在 GitHub 上查看原仓库