RetiFluidNet: A Self-Adaptive and Multi-Attention Deep Convolutional Network for Retinal OCT Fluid Segmentation

Reza Rasti, Armin Biglari, Mohammad Rezapourian, Ziyun Yang, Sina Farsiu

This paper, published in IEEE Transactions on Medical Imaging, introduces RetiFluidNet, a sophisticated deep learning architecture designed to solve one of the most tedious and error-prone tasks in ophthalmology: segmenting fluid pockets in retinal scans.

TL;DR

RetiFluidNet is a self-adaptive, multi-attention convolutional neural network that automatically segments multiple types of retinal fluids in OCT images. By combining dual-attention mechanisms with a multi-scale self-supervision strategy, it achieves state-of-the-art accuracy across different imaging hardware, significantly outperforming standard models like U-Net.

What Problem Does This Paper Address?

Optical Coherence Tomography (OCT) is the gold standard for imaging the retina, allowing doctors to see microscopic layers of the eye. In conditions like Diabetic Macular Edema (DME), fluid accumulates in or under these layers. Quantifying this fluid is critical for treatment, but doing it manually is a nightmare—it's slow, subjective, and prone to human error.

Automating this is difficult because OCT images are "noisy" (speckle noise), have low contrast, and fluid pockets vary wildly in size, shape, and location. Existing AI models often produce "fragmented" results or struggle to distinguish fluid from similar-looking healthy tissue, especially near the edges of a lesion.

Methods

The authors built RetiFluidNet on a U-shaped (encoder-decoder) backbone, but they introduced several novel "upgrades":

  • Self-Adaptive Dual-Attention (SDA) Module: Instead of a static filter, this module uses two trainable parameters to balance spatial attention (where to look in the image) and channel attention (which features are most important). It adaptively tunes itself during training to find the best representation for different fluid types.
  • Self-Adaptive Attention-based Skip Connections (SASC): Standard U-Nets pass information directly from the encoder to the decoder. SASC uses the SDA module to "filter" this information, ensuring only the most relevant contextual features are used to reconstruct the final segmentation map.
  • Residual Multi-Kernel Pooling (RMP): This allows the network to "see" at multiple scales simultaneously, which is essential for detecting both tiny micro-cysts and large fluid-filled detachments.
  • Deep Self-Supervision Learning (DSL): The model doesn't just learn from the final output. It calculates "auxiliary" losses at multiple internal stages of the decoder, forcing the network to learn robust features at every resolution level.
  • Joint Loss Function: They combined standard Dice overlap loss with a specialized edge-preserved connectivity-based loss. This ensures that the segmented regions aren't just accurate in pixel count, but are also spatially coherent with sharp, clean boundaries.

Datasets

The model was rigorously tested on three major public benchmarks:

  1. RETOUCH: A multi-scanner dataset (Cirrus, Spectralis, Topcon) used to segment three fluid types: Intraretinal Fluid (IRF), Subretinal Fluid (SRF), and Pigment Epithelial Detachment (PED).
  2. OPTIMA: Focused on Intraretinal Cystoid Fluid (IRC).
  3. DUKE: Specifically targeting DME-relevant fluids.

Key Insights and Ideas

  • Trainable Balance: One of the "aha" moments is the use of just two trainable parameters ($\alpha$ and $\beta$) in the SDA module. This tiny addition allows the network to decide for itself whether spatial or channel information is more important for a specific task, making the model highly flexible without adding massive computational overhead.
  • Connectivity is Key: The authors realized that standard loss functions often ignore whether pixels are actually connected. By integrating a connectivity-based loss (the "Bicon" loss), they significantly reduced the "checkerboard" or fragmented artifacts common in deep learning segmentation.
  • Hardware Agnostic: A major hurdle in medical AI is that a model trained on one brand of scanner often fails on another. RetiFluidNet showed remarkable stability across different OCT manufacturers, suggesting it is more "instrument-invariant" than its predecessors.

Key Results

  • Superior Accuracy: On the RETOUCH dataset, RetiFluidNet achieved an average Dice Similarity Coefficient (DSC) of 86.6% and a Balanced Accuracy of 94.9%.
  • Beating the Competition: It outperformed MsTGANet (the previous best-performing baseline) by 3.1% in DSC and 0.7% in accuracy.
  • Ablation Success: When the authors removed the connectivity-based loss (the CLC term), performance dropped by up to 6.1% for certain fluid types, proving that their focus on edge-preservation was a winning strategy.
  • Efficiency: Despite its complexity, the model maintains a competitive inference time (approx. 0.44 seconds per B-scan), making it viable for near-real-time clinical use.

Limitations and Future Work

  • 2D vs. 3D: The current model processes OCT scans slice-by-slice (2D). While effective, the authors acknowledge that a fully 3D version could better capture the volumetric nature of retinal fluids.
  • Computational Cost: The Deep Self-Supervision (DSL) scheme makes the training phase slightly slower than simpler models, though this doesn't affect the speed of the final "deployed" model.
  • Data Scarcity: Like all deep learning models, it requires high-quality, pixel-level annotations, which are expensive and difficult to obtain in the medical field. Future work may look into semi-supervised or self-supervised methods to reduce this reliance.

Summary updated

Abstract

Optical coherence tomography (OCT) helps ophthalmologists assess macular edema, accumulation of fluids, and lesions at microscopic resolution. Quantification of retinal fluids is necessary for OCT-guided treatment management, which relies on a precise image segmentation step. As manual analysis of retinal fluids is a time-consuming, subjective, and error-prone task, there is increasing demand for fast and robust automatic solutions. In this study, a new convolutional neural architecture named RetiFluidNet is proposed for multi-class retinal fluid segmentation. The model benefits from hierarchical representation learning of textural, contextual, and edge features using a new self-adaptive dual-attention (SDA) module, multiple self-adaptive attention-based skip connections (SASC), and a novel multi-scale deep self supervision learning (DSL) scheme. The attention mechanism in the proposed SDA module enables the model to automatically extract deformation-aware representations at different levels, and the introduced SASC paths further consider spatial-channel interdependencies for concatenation of counterpart encoder and decoder units, which improve representational capability. RetiFluidNet is also optimized using a joint loss function comprising a weighted version of dice overlap and edge-preserved connectivity-based losses, where several hierarchical stages of multi-scale local losses are integrated into the optimization process. The model is validated based on three publicly available datasets: RETOUCH, OPTIMA, and DUKE, with comparisons against several baselines. Experimental results on the datasets prove the effectiveness of the proposed model in retinal OCT fluid segmentation and reveal that the suggested method is more effective than existing state-of-the-art fluid segmentation algorithms in adapting to retinal OCT scans recorded by various image scanning instruments.
BibTeX
@article{rasti2023retifluidnet,
  author = {Reza Rasti and Armin Biglari and Mohammad Rezapourian and Ziyun Yang and Sina Farsiu},
  title = {{RetiFluidNet: A Self-Adaptive and Multi-Attention Deep Convolutional Network for Retinal OCT Fluid Segmentation}},
  journal = {IEEE Trans. Medical Imaging},
  year = {2023},
  doi = {10.1109/tmi.2022.3228285},
}

Loading related content...

Figure