GeoKV: Geometry-Aware KV Cache Compression via Global Structural Contribution and Key Rectification

Yang Su, Ruihan Hu, Zilong Hu, Tianqi Zhao, Mengzhao He, Haoqi Ruan, Zhaodong Zhang, Zunhai Su, Ngai WongOpenReview 2027 · Submission to ICLR 2027 · Withdrawn · OpenReview

Its authors withdrew this paper, so there is no full text to read or summarize.

Abstract

Vision-Language Models (VLMs) have demonstrated remarkable capabilities, yet the rapidly growing memory consumption of Key-Value (KV) caches poses a major challenge for efficient inference. Existing KV cache compression methods predominantly characterize token importance from a query-dependent functional perspective, such as attention or local relevance, while overlooking the global structural role of cached representations. Consequently, tokens with low current-query relevance may still be important for preserving underrepresented directions and the global geometry of the cached-key space. To address this limitation, we propose GeoKV, a global-structure-aware framework for KV cache compression. Specifically, we introduce Global Structural Contribution (GSC), a query-independent criterion derived from the marginal gain of a regularized log-determinant objective, and perform greedy selection to preserve structurally valuable tokens. We further introduce a lightweight geometry-aware key rectification module based on a low-rank feature-space transformation to mitigate compression-induced geometric distortion. Extensive experiments on VLMs demonstrate that GeoKV effectively reduces KV cache size while maintaining model performance. Comprehensive analyses further show that structural contribution captures complementary information beyond query-dependent functional relevance.
BibTeX
@misc{su2027geokv,
  author = {Yang Su and Ruihan Hu and Zilong Hu and Tianqi Zhao and Mengzhao He and Haoqi Ruan and Zhaodong Zhang and Zunhai Su and Ngai Wong},
  title = {{GeoKV: Geometry-Aware KV Cache Compression via Global Structural Contribution and Key Rectification}},
  year = {2027},
  url = {https://openreview.net/forum?id=yQqanj3O42},
  howpublished = {OpenReview},
  note = {Submitted to ICLR 2027},
}

Loading related content...

Figure