Edge-Sensitive Human Cutout With Hierarchical Granularity and Loopy Matting Guidance

Jingwen Ye, Yongcheng Jing, Xinchao Wang, Kairi Ou, Dacheng Tao, Mingli SongIEEE TIP 2020 · DOI · OpenReview

Abstract

Human parsing and matting play important roles in various applications, such as dress collocation, clothing recommendation, and image editing. In this paper, we propose a lightweight hybrid model that unifies the fully-supervised hierarchical-granularity parsing task and the unsupervised matting one. Our model comprises two parts, the extensible hierarchical semantic segmentation block using CNN and the matting module composed of guided filters. Given a human image, the segmentation block stage-1 first obtains a primitive segmentation map to separate the human and the background. The primitive segmentation is then fed into stage-2 together with the original image to give a rough segmentation of human body. This procedure is repeated in the stage-3 to acquire a refined segmentation. The matting module takes as input the above estimated segmentation maps and produces the matting map, in a fully unsupervised manner. The obtained matting map is then in turn fed back to the CNN in the first block for refining the semantic segmentation results.
BibTeX
@article{ye2020edge,
  author = {Jingwen Ye and Yongcheng Jing and Xinchao Wang and Kairi Ou and Dacheng Tao and Mingli Song},
  title = {{Edge-Sensitive Human Cutout With Hierarchical Granularity and Loopy Matting Guidance}},
  journal = {IEEE Trans. Image Process.},
  year = {2020},
  doi = {10.1109/tip.2019.2930146},
}

Loading related content...

Figure