Co-Attentive Lifting for Infrared-Visible Person Re-Identification

Xing Wei, Diangang Li, Xiaopeng Hong, Wei Ke, Yihong Gong

Abstract

Infrared-visible cross-modality person re-identification (IV-ReID) has attracted much attention with the popularity of dual-mode video surveillance systems, where the RGB mode works in the daytime and automatically switches to the infrared mode at night. Despite its significant application value, IV-ReID remains a difficult problem mainly due to two great challenges. First, it is difficult to identify persons in the infrared image, which lacks color and texture clues. Second, there is a significant gap between the infrared and visible modalities where appearances of the same person vary considerably. This paper proposes a novel attention-based approach to handle the two difficulties in a unified framework. 1) We propose an attention lifting mechanism to learn discriminative features in each modality. 2) We propose a co-attentive learning mechanism to bridge the gap between the two modalities. Our method only makes slight modifications of a given backbone network and requires small computation overhead while improving the performance significantly. We conduct extensive experiments to demonstrate the superiority of our proposed method.
BibTeX
@inproceedings{wei2020co,
  author = {Xing Wei and Diangang Li and Xiaopeng Hong and Wei Ke and Yihong Gong},
  title = {{Co-Attentive Lifting for Infrared-Visible Person Re-Identification}},
  booktitle = {ACM Multimedia},
  year = {2020},
  doi = {10.1145/3394171.3413933},
}

Loading related content...

Figure