Rethinking the U-Shape Structure for Salient Object Detection

Jiang-Jiang Liu, Zhi-Ang Liu, Pai Peng, Ming-Ming Cheng

Abstract

The U-shape structure has shown its advantage in salient object detection for efficiently combining multi-scale features. However, most existing U-shape-based methods focused on improving the bottom-up and top-down pathways while ignoring the connections between them. This paper shows that we can achieve the cross-scale information interaction by centralizing these connections, hence obtaining semantically stronger and positionally more precise features. To inspire the newly proposed strategy’s potential, we further design a relative global calibration module that can simultaneously process multi-scale inputs without spatial interpolation. Our approach can aggregate features more effectively while introducing only a few additional parameters. Our approach can cooperate with various existing U-shape-based salient object detection methods by substituting the connections between the bottom-up and top-down pathways. Experimental results demonstrate that our proposed approach performs favorably against the previous state-of-the-arts on five widely used benchmarks with less computational complexity. The source code will be publicly available.
BibTeX
@article{liu2021rethinking,
  author = {Jiang-Jiang Liu and Zhi-Ang Liu and Pai Peng and Ming-Ming Cheng},
  title = {{Rethinking the U-Shape Structure for Salient Object Detection}},
  journal = {IEEE Trans. Image Process.},
  year = {2021},
  doi = {10.1109/tip.2021.3122093},
}

Loading related content...

Figure