IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact
Ruikang Liu, Haoli Bai, Haokun Lin, Yuening Li, Han Gao, Zheng-Jun Xu, Lu Hou, Jun Yao, Chun Yuan
Annual Meeting of the Association for Computational Linguistics