End-to-End Segmentation of Medical Images via Patch-Wise Polygons Prediction

Tal Shaharabany, Lior Wolf

Abstract

The leading medical image segmentation methods represent the output map as a pixel grid. We present an alternative in which the object edges are modeled, per image patch, as a polygon with k vertices that is coupled with per-patch label probabilities. The vertices are optimized by employing a differentiable neural renderer to create a raster image. The delineated region is then compared with the ground truth segmentation. Our method obtains multiple state-of-the-art results for the Gland segmentation dataset (Glas), the Nucleus challenges (MoNuSeg), and multiple polyp segmentation datasets, as well as for non-medical benchmarks, including Cityscapes, CUB, and Vaihingen. Our code for training and reproducing these results is attached as a supplement.
BibTeX
@inproceedings{shaharabany2022end,
  author = {Tal Shaharabany and Lior Wolf},
  title = {{End-to-End Segmentation of Medical Images via Patch-Wise Polygons Prediction}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2022},
  doi = {10.1007/978-3-031-16443-9\_30},
}

Loading related content...

Figure