BAProto: Boundary-Aware Prototype for High-quality Instance Segmentation

Yuxuan Zhang, Wei Yang, Rong HuICME 2023 · OpenReview

Abstract

To date, the boundary quality remains unsatisfactory in instance segmentation, resulting in increasing attention to the mask refinement mechanism. Such a mechanism is supposed to be accurate, efficient and generic to the existing models. Yet, few methods met the three factors simultaneously. In this paper, to address this issue, we propose a Boundary-Aware Prototype (BAProto) for boundary refinement, which conducts pixel-wise prediction through the similarity of boundary representation and the specific prototype. Such a prototype is obtained by a memory unit for comprehensive learning. To our best knowledge, BAProto is the first approach that satisfies the above three factors at the same time. In particular, we elaborately design a three-phase segmentation loss, focusing on the learning of different regions to extract discriminating boundary representations for prototype establishment. Extensive experimental results show that BAProto is precise, efficient and model-agnostic on COCO and Cityscapes datasets.
BibTeX
@inproceedings{zhang2023baproto,
  author = {Yuxuan Zhang and Wei Yang and Rong Hu},
  title = {{BAProto: Boundary-Aware Prototype for High-quality Instance Segmentation}},
  booktitle = {ICME},
  year = {2023},
  url = {https://openreview.net/forum?id=rf9UWlu7IR},
}

Loading related content...

Figure