Unsupervised Domain Adaptive Thermal Infrared Tracking

Qiao Liu, Qiao Li, Xin Li, Jiatian Pi, Di Yuan, Yunpeng LiuIEEE Trans. Multimedia 2026 · DOI

Abstract

Existing deep Thermal InfraRed (TIR) trackers often use RGB datasets for training due to the lack of large-scale labeled TIR datasets. However, the performance of these methods on TIR image sequences is significantly degraded, because of the domain shift problem between the RGB and TIR datasets. To solve this problem, in this paper, we propose an unsupervised Dual-level Domain Adaptation TIR Tracking framework (DDAT), which can benefit from training on large-scale labeled RGB datasets and unlabeled TIR datasets. Specifically, to transfer the useful knowledge learned from RGB dataset to TIR tracking, we first propose an adversarial-based adaptation module on both the semantic-level and the feature-level. While the semantic-level adaptation can reduce the semantic gap between the TIR and RGB tracking tasks, the feature-level adaptation can learn domain-invariant features for more robust tracking. Second, we propose a partial domain adaptation module to alleviate the negative transfer problem because the RGB and TIR tracking domains have a non-identical class and feature spaces. Instead of aligning the entire feature space, this module adaptively selects partial similarity samples and features for alignment, thus getting more fine-grained aligned results. Third, we collect a currently largest-scale unlabeled TIR dataset to train the proposed framework. Extensive experiments on five TIR tracking benchmarks demonstrate the proposed method is effective and sets a new state-of-the-art.
BibTeX
@article{liu2026unsupervised,
  author = {Qiao Liu and Qiao Li and Xin Li and Jiatian Pi and Di Yuan and Yunpeng Liu},
  title = {{Unsupervised Domain Adaptive Thermal Infrared Tracking}},
  journal = {IEEE Transactions on Multimedia},
  year = {2026},
  doi = {10.1109/tmm.2026.3668654},
}

Loading related content...

Figure