Missing Recovery: Single Image Reflection Removal Based on Auxiliary Prior Learning

Wei-Ting Chen, Kuan-Yu Chen, I-Hsiang Chen, Hao-Yu Fang, Jian-Jiun Ding, Sy-Yen Kuo

Abstract

Photographs taken through a glass window are susceptible to disturbances due to reflection. Therefore, single image reflection removal is crucial to image quality enhancement. In this paper, a novel learning architecture that can address this ill-posed problem is proposed. First, a novel reflection removal pipeline was designed to reconstruct the missing information caused by the camera imaging process using the proposed missing recovery network. Second, to address the issues in existing reflection removal strategies, we revisit several auxiliary priors and integrate them by defining an energy function. To solve the energy function, a convolutional neural network-based optimization scheme was proposed. Finally, we investigated the dark channel responses of reflection and clean images and found an interesting way to distinguish between these two types of images. We prove this property mathematically and propose a novel loss function called dark channel loss to improve performance. Experiments show that the proposed method outperforms state-of-the-art reflection removal methods both quantitatively and qualitatively.
BibTeX
@article{chen2023missing,
  author = {Wei-Ting Chen and Kuan-Yu Chen and I-Hsiang Chen and Hao-Yu Fang and Jian-Jiun Ding and Sy-Yen Kuo},
  title = {{Missing Recovery: Single Image Reflection Removal Based on Auxiliary Prior Learning}},
  journal = {IEEE Trans. Image Process.},
  year = {2023},
  doi = {10.1109/tip.2022.3230544},
}

Loading related content...

Figure