AN L2-Normalized Spatial Attention Network for Accurate and Fast Classification of Brain Tumors in 2D T1-Weighted CE-MRI Images

Grace Billingsley, Julia Dietlmeier, Vivek Sivaraman Narayanaswamy, Andreas Spanias, Noel E. O'Connor

Introduction

Brain cancer remains a significant health challenge, ranking as the 10th leading cause of death for adults. Early and accurate diagnosis via Magnetic Resonance Imaging (MRI) is critical for effective treatment planning. While deep learning has significantly advanced medical image analysis, a major hurdle persists: the high computational cost of state-of-the-art models. Many high-performance architectures are "heavyweight," requiring substantial memory and processing power, which makes them impractical for real-time clinical workstations or portable medical devices. This research addresses the need for a "lightweight" model—defined by an inference time of less than 20ms—that maintains high diagnostic accuracy for distinguishing between Gliomas, Meningiomas, and Pituitary tumors.

Methods: The $L_2$-SA Architecture

The researchers propose the $L_2$-SA model, a shallow convolutional neural network enhanced by a novel $L_2$-normalized spatial attention block ($L_2$-SAB). Unlike deep architectures like ResNet-50, this model utilizes a backbone of only three convolutional layers and three Max-Pooling layers to minimize parameter count.

Architecture of the proposed L2-SA network featuring L2-normalized spatial attention blocks (L2-SAB) and skip connections.

The core innovation lies in the modified attention mechanism. Building on the Convolutional Block Attention Module (CBAM), the authors introduced two key changes:

  1. Max-Min Pooling: Instead of standard "max and average" pooling, they employed "max and min" pooling. This approach captures the difference between extreme feature values, which the authors argue provides a more discriminative representation of subtle tumor outlines.
  2. $L_2$-Normalization: $L_2$-normalization is applied to the feature maps before subtraction. This acts as a powerful regularizer, ensuring each input in a batch has a norm of 1, which prevents overfitting on small medical datasets and accelerates training convergence.
  3. Multiplicative Skip Connections: The architecture incorporates specific skip connections (labeled A, B, and C) to preserve spatial information across the network layers.

Dataset and Experimental Setup

The model was evaluated using the 2D T1-weighted CE-MRI dataset (Cheng et al.), containing 3,064 contrast-enhanced images from 233 patients. The dataset includes three tumor types: Meningioma (708), Glioma (1,426), and Pituitary (930). This dataset is particularly challenging due to the wide variance in tumor sizes and the tendency for tumor intensities to blend with surrounding brain tissue. The study employed a 70/10/20 split for training, validation, and testing.

Key Results and Performance

The $L_2$-SA model demonstrated a superior balance of speed and precision. It achieved an accuracy of 96.57%, a 1.79 percentage point improvement over the baseline shallow network.

Performance comparison of the proposed L2-SA model against existing state-of-the-art and baseline architectures.

Crucially, the model maintained an inference time of 19ms, meeting the criteria for lightweight edge computing. As shown in the comparative results, the $L_2$-SA model outperformed several established methods, including a fine-tuned VGG16 (93.31%), while being significantly faster. While an ensemble of $L_2$-SA and VGG16 reached a slightly higher accuracy of 96.74%, its inference time jumped to 115ms, underscoring the efficiency of the standalone $L_2$-SA model.

Discussion and Future Work

The findings suggest that "deeper" is not always "better" for specific medical imaging tasks. The integration of $L_2$-normalization was pivotal; the authors noted that standard attention mechanisms without normalization did not yield significant improvements in their shallow architecture.

However, limitations remain. The dataset is dominated by Glioma cases, and further validation on more balanced or larger-scale datasets is necessary. Future work will focus on testing the $L_2$-SA approach across different MRI modalities and evaluating its impact on real-world clinical workflows in hospital settings.

Summary updated

BibTeX
@inproceedings{billingsley2023l,
  author = {Grace Billingsley and Julia Dietlmeier and Vivek Sivaraman Narayanaswamy and Andreas Spanias and Noel E. O'Connor},
  title = {{AN L2-Normalized Spatial Attention Network for Accurate and Fast Classification of Brain Tumors in 2D T1-Weighted CE-MRI Images}},
  booktitle = {ICIP},
  year = {2023},
  doi = {10.1109/icip49359.2023.10222887},
}
Figure