Segmentation of Laser Marks of Diabetic Retinopathy in the Fundus Photographs Using Lightweight U-Net

Yukang Jiang, Jianying Pan, Ming Xia Yuan, Yanhe Shen, Jin Zhu, Yishen Wang, Yewei Li, Ke Zhang, Qingyun Yu, Huirui Xie, Huiting Li, Xueqin Wang, Yan LuoJournal of Diabetes Research 2021 · DOI

TL;DR

This paper introduces a lightweight U-Net model for automatically segmenting laser marks in fundus photographs, a crucial step in diagnosing and managing severe diabetic retinopathy (DR). By combining a novel lightweight U-Net architecture with clinically-informed postprocessing steps, the model achieves high accuracy, paving the way for more efficient and reliable AI-assisted DR screening.

What Problem Does This Paper Address?

Diabetic retinopathy (DR) is a leading cause of vision loss worldwide. For patients with severe DR, panretinal photocoagulation (PRP) is a common treatment that leaves behind characteristic "laser marks" on the retina. Identifying and accurately segmenting these marks is vital for classifying the stage of DR (e.g., distinguishing between active proliferative DR (PDR) and stable PDR after treatment) and guiding follow-up care. Current automated systems often struggle with precise laser mark segmentation, and there's a lack of publicly available, pixel-level annotated datasets for this specific task. This gap hinders the development of robust AI tools that can reliably assist ophthalmologists in DR diagnosis and management.

Methods

The core of this work is a lightweight U-Net architecture, adapted from existing U-Net models. The key modifications include:

  • Downscaling: The network is reduced to a three-scaled architecture with only five dense convolutional blocks.
  • Feature Channel Reduction: The number of feature channels in each block is halved compared to standard U-Net.
  • Padding Strategy: A specific padding strategy is employed in convolutional operations to preserve marginal information.
  • Dropout: Dropout layers (with a probability of 0.2) are introduced between convolutional layers to combat overfitting.

Beyond the core model, the authors implemented two crucial postprocessing procedures derived from clinical standards for PRP:

  1. Optic Disc (OD) Coverage: Laser marks are not typically applied within or very close to the optic disc. This step identifies the OD and removes any predicted laser marks in this region to reduce false positives.
  2. Macular Region Coverage: Similarly, laser marks are not applied near the macula. This step identifies the macula and removes predicted marks within a defined radius.

These postprocessing steps aim to denoise the segmentation maps and align them with clinical practice.

Datasets

The study utilized a custom dataset of fundus photographs with laser marks.

  • Initial Dataset: 154 fundus photographs.
  • 84 images were manually segmented once by experienced graders (used for pretraining due to coarser annotations).
  • 70 images were manually and independently segmented by three experienced graders, with "gold standard" labels established by at least two graders (used for formal training and testing).
  • Data Splitting: The 70 images with gold standards were randomly split into a formal training set (50 images) and a testing set (20 images).
  • Pretraining Datasets:
    • The DRIVE dataset (40 images, annotated for retinal vessels) was used for initial pretraining to leverage transfer learning.
  • The 84 roughly labeled fundus images were used for a subsequent pretraining step to help the network grasp a coarse understanding of laser marks.

Key Insights and Ideas

  • Lightweight U-Net for Efficiency: Adapting the U-Net architecture to be "lightweight" is a strategic move. This likely leads to faster inference times and reduced computational resource requirements, making it more practical for real-world clinical deployment.
  • Clinical Knowledge Integration is Key: The success of the model is significantly boosted by incorporating clinical knowledge through postprocessing. Simply relying on raw deep learning output is insufficient; aligning predictions with established medical practices (like avoiding the OD and macula) dramatically improves accuracy and reduces clinically irrelevant findings.
  • Transfer Learning Pays Off: Pretraining on the DRIVE dataset, even though it's for vessel segmentation, demonstrates the power of transfer learning. It helps the model learn general image features that are transferable to the laser mark segmentation task, accelerating convergence and improving performance.
  • Publicly Available Dataset is a Game Changer: The creation and potential release of a pixel-level annotated dataset for laser mark segmentation addresses a critical gap in the research community, enabling further development and validation of DR diagnostic tools.

Key Results

The proposed lightweight U-Net model, combined with the two postprocessing procedures, achieved impressive results on the test set:

  • Area Under the Curve (AUC): 0.9824
  • Optimal Sensitivity: 94.16%
  • Optimal Specificity: 92.82%
  • Accuracy: 92.90%
  • Dice Similarity Coefficient (DSC): 71.18%

These metrics represent a notable improvement over the lightweight U-Net alone, particularly in reducing false positives around the optic disc and macula. The authors also reported that the postprocessing procedures improved the visual quality of the segmentation maps, making them clearer and more accurate.

Limitations and Future Work

  • Distinguishing Noises: The model still struggles to differentiate some noises that share similar morphological characteristics with laser marks. Future work could involve adjusting image tone during preprocessing or incorporating methods that combine local and global image information.
  • Dataset Size: The training dataset, while annotated with care, is still relatively small. The authors suggest that increasing the number of fundus photographs, especially from diverse populations, would lead to a more robust and accurate model.
  • Generalizability: While the model shows promise, further validation on larger and more diverse datasets is needed to ensure its generalizability across different patient populations and imaging equipment.

Summary updated

Abstract

Diabetic retinopathy (DR) is a prevalent vision-threatening disease worldwide. Laser marks are the scars left after panretinal photocoagulation, a treatment to prevent patients with severe DR from losing vision. In this study, we develop a deep learning algorithm based on the lightweight U-Net to segment laser marks from the color fundus photos, which could help indicate a stage or providing valuable auxiliary information for the care of DR patients. We prepared our training and testing data, manually annotated by trained and experienced graders from Image Reading Center, Zhongshan Ophthalmic Center, publicly available to fill the vacancy of public image datasets dedicated to the segmentation of laser marks. The lightweight U-Net, along with two postprocessing procedures, achieved an AUC of 0.9824, an optimal sensitivity of 94.16%, and an optimal specificity of 92.82% on the segmentation of laser marks in fundus photographs. With accurate segmentation and high numeric metrics, the lightweight U-Net method showed its reliable performance in automatically segmenting laser marks in fundus photographs, which could help the AI assist the diagnosis of DR in the severe stage.
BibTeX
@article{jiang2021segmentation,
  author = {Yukang Jiang and Jianying Pan and Ming Xia Yuan and Yanhe Shen and Jin Zhu and Yishen Wang and Yewei Li and Ke Zhang and Qingyun Yu and Huirui Xie and Huiting Li and Xueqin Wang and Yan Luo},
  title = {{Segmentation of Laser Marks of Diabetic Retinopathy in the Fundus Photographs Using Lightweight U-Net}},
  journal = {Journal of Diabetes Research},
  year = {2021},
  doi = {10.1155/2021/8766517},
}
Figure