Deep Group-Wise Fully Convolutional Network for Co-Saliency Detection With Graph Propagation

Lina Wei, Shanshan Zhao, Omar El Farouk Bourahla, Xi Li, Fei Wu, Yueting Zhuang

Abstract

A key problem in co-saliency detection is how to effectively model the interactive relationship of a whole image group and the individual perspective of each image in a united data-driven manner. In this paper, we propose a group-wise deep co-saliency detection approach to address the co-saliency object discovery problem based on the fully convolutional network (FCN). The proposed approach captures the group-wise interaction information for group images by learning a semantics-aware image representation based on a convolutional neural network, which adaptively learns the group-wise features for co-saliency detection. Furthermore, the proposed approach discovers the collaborative and interactive relationships between group-wise feature representation and single-image individual feature representation and models this in a collaborative learning framework. Then, we set up a unified deep learning scheme to jointly optimize the process of group-wise feature representation learning and collaborative learning, leading to more reliable and robust co-saliency detection results. Finally, we present a graph Laplacian regularized nonlinear regression model for saliency refinement. The experimental results demonstrate the effectiveness of our approach in comparison with the state-of-the-art approaches.
BibTeX
@article{wei2019deep,
  author = {Lina Wei and Shanshan Zhao and Omar El Farouk Bourahla and Xi Li and Fei Wu and Yueting Zhuang},
  title = {{Deep Group-Wise Fully Convolutional Network for Co-Saliency Detection With Graph Propagation}},
  journal = {IEEE Trans. Image Process.},
  year = {2019},
  doi = {10.1109/tip.2019.2909649},
}

Loading related content...

Figure