Learnable contextual regularization for semantic segmentation of indoor scene images

Jun Chu, Xu Xiao, Gaofeng Meng, Lingfeng Wang, Chunhong Pan

Abstract

Semantic segmentation of indoor scene images has a wide range of applications. However, due to a large number of classes and uneven distribution in indoor scenes, mislabels are often made when facing small objects or boundary regions. Technically, contextual information may benefit for segmentation results, but has not yet been exploited sufficiently. In this paper, we propose a learnable contextual regularization model for enhancing the semantic segmentation results of color indoor scene images. This regularization model is combined with a deep convolutional segmentation network without significantly increasing the number of additional parameters. Our model, derived from the inherent contextual regularization on the indoor scene objects, benefits much from the learnable constraint layers bridging the lower layers and the higher layers in the deep convolutional network. The constraint layers are further integrated with a weighted L1-norm based contextual regularization between the neighboring pixels of RGB values to improve the segmentation results. Experimental results on NYUDv2 indoor scene dataset demonstrate the effectiveness and efficiency of the proposed method.
BibTeX
@inproceedings{chu2017learnable,
  author = {Jun Chu and Xu Xiao and Gaofeng Meng and Lingfeng Wang and Chunhong Pan},
  title = {{Learnable contextual regularization for semantic segmentation of indoor scene images}},
  booktitle = {ICIP},
  year = {2017},
  doi = {10.1109/icip.2017.8296485},
}

Loading related content...

Figure