QoKV: Comprehending and Surpassing the Hurdles of KV Cache Quantization

Jinguang Wang, Yuexi Yin, Haifeng Sun, Tingting Yang, Qi Qi, Zirui Zhuang, Jingyu WangICASSP 2025 · DOI

BibTeX
@inproceedings{wang2025qokv,
  author = {Jinguang Wang and Yuexi Yin and Haifeng Sun and Tingting Yang and Qi Qi and Zirui Zhuang and Jingyu Wang},
  title = {{QoKV: Comprehending and Surpassing the Hurdles of KV Cache Quantization}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2025},
  doi = {10.1109/icassp49660.2025.10890716},
}

Loading related content...

Figure