Weakly supervised pseudo label generation for construction vehicle segmentation

Wei‐Chih Chern, Vijayan K. Asari, Tam Nguyen, Hongjo KimProceedings of the ... ISARC 2022 · DOI

Abstract

Weakly supervised pseudo label generation for construction vehicle segmentation Wei-Chih Chern, Vijayan Asari, Tam Nguyen and Hongjo Kim Pages 41-46 (2022 Proceedings of the 39th ISARC, Bogotá, Colombia, ISBN 978-952-69524-2-0, ISSN 2413-5844) Abstract: Segmentation tasks in computer vision have been adopted in various studies in the civil engineering domain to provide accurate object locations in images. However, preparing an-notation to train segmentation models is a time consuming and costly process, which hinders the use of segmentation models in vision-based applications. To address the problem, this study proposes a fusion model integrating self-supervised equivariant attention mechanism (SEAM) and sub-category exploration (SC-CAM) to generate pseudo labels in the form of polygon annotation from bounding box annotation that is relatively easy to obtain. To test the performance of the fusion model, a public data set - Advanced Infrastructure Management Group (AIM) dataset - for construction object detection was selected to generate pseudo labels; the effec-tiveness of pseudo labels was measured by the segmentation performance of a feature pyramid network (FPN) trained with the pseudo labels. FPN showed the mean intersection over union (mIoU) score of 86.03%, demonstrating the po-tential of the proposed fusion model to reduce the manual annotation efforts in preparing training data for segmenta-tion models. Keywords: Weakly supervised learning; Semantic segmentation; Pseudo labels; Training data preparation DOI: https://doi.org/10.22260/ISARC2022/0008 Download fulltext Download BibTex Download Endnote (RIS) TeX Import to Mendeley
BibTeX
@inproceedings{chern2022weakly,
  author = {Wei‐Chih Chern and Vijayan K. Asari and Tam Nguyen and Hongjo Kim},
  title = {{Weakly supervised pseudo label generation for construction vehicle segmentation}},
  booktitle = {Proceedings of the ... ISARC},
  year = {2022},
  doi = {10.22260/isarc2022/0008},
}

Loading related content...

Figure