A Lightweight Entropy–Curvature-Based Attention Mechanism for Meningioma Segmentation in MRI Images

Yifan Guan, Lei Zhang, Jiayi Li, Xiaolong Xu, Yan Yu, Leyi ZhangApplied Sciences 2025 · DOI

TL;DR

This paper introduces a novel, lightweight attention mechanism called Entropy-Curvature-Based Attention (ECA) for segmenting meningiomas in 3D MRI images. ECA significantly improves segmentation accuracy and efficiency by combining a tri-axial pooling method with entropy and curvature-based attention modules, outperforming existing state-of-the-art methods.

What Problem Does This Paper Address?

Meningiomas, the most common primary intracranial tumors, require precise and rapid localization for effective clinical management. While MRI is the standard imaging modality, segmenting these tumors from 3D MRI data is computationally intensive and memory-demanding, often leading to a trade-off between accuracy and efficiency. Existing deep learning models, particularly those using 3D convolutions or complex attention mechanisms, can be resource-heavy, limiting their practical application. The paper aims to address this by developing a lightweight yet highly accurate attention mechanism that can be easily integrated into existing segmentation architectures.

Methods

The core contribution is the Entropy-Curvature-Based Attention (ECA) module, designed to be plug-and-play and enhance segmentation performance while reducing computational load. ECA comprises three key components:

  • Tri-Axial Strip Pooling (TSP): This novel pooling method compresses 3D MRI data into three 2D feature maps by processing sagittal, coronal, and transverse planes independently. This dimensionality reduction significantly reduces computational complexity and memory requirements, allowing 2D attention techniques to be applied to 3D data while preserving global information.
  • Entropy-Guided Attention (EGA): This module leverages information entropy to filter noise and highlight informative regions. Instead of traditional thresholding, it divides feature maps into small windows and uses a top-k algorithm to select the most information-rich areas, effectively enhancing feature representation.
  • Curvature Filter Attention (CFA): This module focuses on extracting local edge features. It uses a learnable matrix to approximate curvature, allowing it to precisely capture object boundaries and details, which is crucial for accurate segmentation.

These three components are sequentially arranged within the ECA module, which is then embedded into the encoder and skip connections of a standard U-Net-like segmentation architecture.

Datasets

The proposed method was validated on two datasets:

  • Private Meningioma Dataset: Collected from the Neurosurgery Department of West China Hospital, containing T1-weighted MRI scans of 500 meningioma patients. Manual segmentation labels were provided by experienced neurosurgeons. The dataset was split into training (345 cases), validation (100 cases), and testing (65 cases).
  • BraTS2021 Dataset: A public benchmark dataset widely used for brain tumor segmentation, containing multimodal MRI scans (T1, T1ce, T2, FLAIR) of glioma patients. The paper utilized a subset of 1237 cases, split into training (700 cases), validation (299 cases), and testing (252 cases).

Key Insights and Ideas

  • Bridging 2D and 3D: The tri-axial strip pooling (TSP) is a clever way to reduce the dimensionality of 3D data to 2D, enabling the efficient application of powerful 2D attention mechanisms without losing crucial spatial context.
  • Synergy of Entropy and Curvature: Combining information entropy (for noise reduction and feature highlighting) with curvature (for precise edge detection) creates a robust attention mechanism that can handle both noisy and detailed regions effectively.
  • Lightweight but Powerful: The ECA module demonstrates that significant improvements in segmentation accuracy can be achieved with a focus on computational efficiency, making advanced deep learning models more accessible for clinical use.
  • Plug-and-Play Advantage: The design of ECA as a modular component allows it to be easily integrated into various existing segmentation architectures, offering flexibility and broad applicability.

Key Results

  • Meningioma Dataset: ECA achieved a Dice Similarity Coefficient (DSC) of 89.22% and a 95% Hausdorff Distance (HD95) of 2.88 mm, outperforming all compared state-of-the-art methods in both metrics. It also demonstrated superior performance in terms of computational cost (FLOPs: 977.02, Params: 22.38).
  • BraTS2021 Dataset: ECA achieved high DSC scores across different tumor regions (WT: 83.07%, TC: 87.04%, ET: 87.15%) and the lowest HD95 values (WT: 3.69 mm, ET: 2.26 mm), indicating excellent boundary accuracy.
  • Robustness to Noise: When Gaussian noise was added to the meningioma test set, ECA's DSC only decreased by 0.2% and HD95 by 0.12%, highlighting its superior noise-elimination capabilities.
  • Ablation Studies: Both EGA and CFA modules individually contributed to performance improvements, but their combined use in ECA yielded the best results, demonstrating their synergistic effect.

Limitations and Future Work

  • Generalizability: While ECA shows promise for meningioma segmentation, its generalization to other medical image segmentation tasks, such as blood vessel segmentation, needs further investigation.
  • Further Lightweighting: The authors suggest exploring further lightweight operations and potentially applying the model to real-time surgical video segmentation.
  • TC Region in BraTS: The paper notes that ECA, while excellent overall, struggled slightly with the uncertain shape and scattered distribution of the Tumor Core (TC) in the BraTS dataset, suggesting room for improvement in handling such complex regions.

Summary updated

Abstract

Meningiomas are a common type of brain tumor. Due to their location within the cranial cavity, they can potentially cause irreversible damage to adjacent brain tissues. Clinical practice typically involves surgical resection for tumors that provoke symptoms and exhibit continued growth. Given the variability in the size and location of meningiomas, achieving rapid and precise localization is critical in clinical practice. Typically, meningiomas are imaged using magnetic resonance imaging (MRI), which produces 3D images that require significant memory resources for the segmentation task. In this paper, a lightweight 3D attention mechanism based on entropy–curvature (ECA) is proposed, which significantly enhances both parameter efficiency and inference accuracy. This attention mechanism uses a pooling method and two spatial attention modules to effectively reduce computational complexity while capturing spatial feature information. In terms of pooling, a tri-axis pooling method is developed to maximize information retention during the dimensionality reduction process of meningioma data, allowing the application of two-dimensional attention techniques to 3D medical images. Subsequently, this mechanism utilizes information entropy and curvature filters to filter noise and enhance feature information. Moreover, to validate the proposed method, the meningioma dataset from West China Hospital’s Department of Neurosurgery and the BraTS2021 dataset are used in our experiments. The results demonstrated superior performance compared to the state-of-the-art methods.
BibTeX
@inproceedings{guan2025lightweight,
  author = {Yifan Guan and Lei Zhang and Jiayi Li and Xiaolong Xu and Yan Yu and Leyi Zhang and Leyi Zhang and Leyi Zhang},
  title = {{A Lightweight Entropy–Curvature-Based Attention Mechanism for Meningioma Segmentation in MRI Images}},
  booktitle = {Applied Sciences},
  year = {2025},
  doi = {10.3390/app15063401},
}
Figure