A Segmentation Based Robust Deep Learning Framework for Multimodal Retinal Image Registration

Yiqian Wang, Junkang Zhang, Cheolhong An, Melina Cavichini, Mahima Jhingan, Manuel J. Amador-Patarroyo, Christopher P. Long, Dirk-Uwe G. Bartsch, William R. Freeman, Truong Q. NguyenICASSP 2020 · OpenReview

Abstract

Multimodal image registration plays an important role in diagnosing and treating ophthalmologic diseases. In this paper, a deep learning framework for multimodal retinal image registration is proposed. The framework consists of a segmentation network, feature detection and description network, and an outlier rejection network, which focuses only on the globally coarse alignment step using the perspective transformation. We apply the proposed framework to register color fundus images with infrared reflectance images and compare it with the state-of-the-art conventional and learning-based approaches. The proposed framework demonstrates a significant improvement in robustness and accuracy reflected by a higher success rate and Dice coefficient compared to other coarse alignment methods.
BibTeX
@inproceedings{wang2020segmentation,
  author = {Yiqian Wang and Junkang Zhang and Cheolhong An and Melina Cavichini and Mahima Jhingan and Manuel J. Amador-Patarroyo and Christopher P. Long and Dirk-Uwe G. Bartsch and William R. Freeman and Truong Q. Nguyen},
  title = {{A Segmentation Based Robust Deep Learning Framework for Multimodal Retinal Image Registration}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2020},
  url = {https://openreview.net/forum?id=vPpvwwScIC_},
}

Loading related content...

Figure