tonyzhao-jt/LLM-PQ

Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and Adaptive Quantization"

语言：Jupyter Notebook · GitHub 星标：41 · Fork：3

在 GitHub 上查看原仓库