Progressive Stereo Image Dehazing Network via Cross-View Region Interaction

Junhu Wang, Yanyan Wei, Zhao Zhang, Jicong Fan, Yang Zhao, Yi Yang, Meng Wang

Abstract

Stereo image dehazing aims to restore haze-free images by leveraging the complementary information contained in binocular images. Current methods primarily focus on designing image-level modules and pipelines to utilize complementary information between the left and right-view images. However, these image-level cross-view interactions overlook regional differences in haze concentration and stereo image disparity maps. Consequently, we propose a Progressive Stereo Image Dehazing Network via Cross-view Region Interaction, termed PSIDNet, which fully considers the internal characteristics and external manifestation of haze and disparity, and explicitly addresses the stereo image dehazing task by a regional-aware interactive mechanism. Specifically, we divide hazy images into regions and independently interact with left and right-view information at region levels, meaning weights are not shared across regional patches. This approach allows us to treat different regions with different priorities, i.e., concentrate on regional patches with heavier haze concentration and larger disparities, hence enabling more accurate restoration of hazy images. Furthermore, we introduce an effective cross-view region interactive block that extracts information based on the channel dimension of dual views and later adopts matrix multiplication to generate mutual attention maps based on the fused features. Extensive experiments on synthetic and real-scenario datasets demonstrate the efficacy of our method, compared to other related monocular and stereo image dehazing and restoration methods.
BibTeX
@article{wang2024progressive,
  author = {Junhu Wang and Yanyan Wei and Zhao Zhang and Jicong Fan and Yang Zhao and Yi Yang and Meng Wang},
  title = {{Progressive Stereo Image Dehazing Network via Cross-View Region Interaction}},
  journal = {IEEE Trans. Multimedia},
  year = {2024},
  url = {https://openreview.net/forum?id=OJkLLeyNUC},
}

Loading related content...

Figure