An Explainable Non-local Network for COVID-19 Diagnosis

Jingfu Yang, Peng Huang, Jing Hu, Shu Hu, Siwei Lyu, Xin Wang, Jun Guo, Xi WuarXiv 2024 · DOI · arXiv

Introduction

Automated medical imaging has seen significant advancements, particularly in the context of the COVID-19 pandemic. This research introduces NL-RAN (Non-local Residual Attention Network), a 3D deep learning model designed to classify lung CT scans into three categories: COVID-19 (Novel Coronavirus Pneumonia), common pneumonia, or normal. By integrating global context with local attention mechanisms, the model achieves a state-of-the-art accuracy of 94.26% while providing high-resolution "heat maps" that pinpoint infection sites for clinical verification.

The Challenge of 3D Medical Diagnosis

Diagnosing COVID-19 from Computed Tomography (CT) scans is labor-intensive and prone to observer variability. Existing AI models often struggle with three major hurdles:

  1. Dimensionality Loss: Processing 3D CT scans as 2D slices loses critical spatial relationships between slices.
  2. Lesion Complexity: Ground-glass opacities vary significantly in size and shape, often exhibiting low contrast against healthy tissue.
  3. The "Black Box" Problem: Clinicians require transparency. Traditional visualization methods like Class Activation Mapping (CAM) are often too blurry or highlight irrelevant background areas for precise clinical use.

Methodology: The NL-RAN Architecture

The proposed NL-RAN architecture utilizes a 3D Residual Network (ResNet) backbone enhanced by two critical components: a 3D Attention Module and a Non-local Module.

The NL-RAN architecture integrates 3D Residual Blocks with Attention Modules and a Non-local Block to capture both fine-grained details and long-range spatial dependencies.

3D Attention Module

This module employs a bottom-up/top-down structure to focus on fine-grained lesion details. It learns a weight matrix that emphasizes infected areas while suppressing healthy tissue, effectively acting as a feature selector for relevant pathological signs.

Non-local Module

Standard convolutions are limited to local neighborhoods. The non-local module calculates relationships between any two points in the 3D volume, regardless of distance. This allows the model to capture "long-range dependencies," providing a global understanding of the lung's state and how disparate lesions relate to one another.

Results and Explainability

The NL-RAN model was evaluated using the CC-CCII dataset, comprising 4,079 3D CT scans. It outperformed mainstream architectures such as CovNet, CBAM, and standard 3D ResNet, achieving an AUC of 0.9897—approaching near-perfect separation between classes.

Beyond raw performance, the model's primary strength lies in its "Explainability by Design." Instead of using post-hoc mathematical approximations to guess what the model saw, the internal attention maps are exported directly to serve as high-resolution thermograms of the infection.

Comparison of raw CT scans (top) with attention-based heatmaps (bottom). The red arrows indicate lesions, which the model precisely identifies in the high-resolution maps (g-i), offering superior clarity compared to traditional CAM methods (d-f).

As shown in the visualization, the NL-RAN attention maps provide tight, accurate boundaries around specific lesions. This precision makes the model a viable tool for real-time diagnostic assistance, allowing clinicians to verify the AI's reasoning instantly. Despite its complexity, the model remains efficient, processing 400 samples in under 15 seconds on consumer-grade hardware.

Conclusion

NL-RAN represents a significant step toward trustworthy AI in healthcare. By combining 3D spatial awareness with non-local dependencies and direct attention visualization, the researchers have created a system that is both highly accurate and clinically interpretable. Future work will focus on validating this architecture across more diverse datasets and extending its application to other medical imaging modalities like MRI.

Summary updated

Abstract

The CNN has achieved excellent results in the automatic classification of medical images. In this study, we propose a novel deep residual 3D attention non-local network (NL-RAN) to classify CT images included COVID-19, common pneumonia, and normal to perform rapid and explainable COVID-19 diagnosis. We built a deep residual 3D attention non-local network that could achieve end-to-end training. The network is embedded with a nonlocal module to capture global information, while a 3D attention module is embedded to focus on the details of the lesion so that it can directly analyze the 3D lung CT and output the classification results. The output of the attention module can be used as a heat map to increase the interpretability of the model. 4079 3D CT scans were included in this study. Each scan had a unique label (novel coronavirus pneumonia, common pneumonia, and normal). The CT scans cohort was randomly split into a training set of 3263 scans, a validation set of 408 scans, and a testing set of 408 scans. And compare with existing mainstream classification methods, such as CovNet, CBAM, ResNet, etc. Simultaneously compare the visualization results with visualization methods such as CAM. Model performance was evaluated using the Area Under the ROC Curve(AUC), precision, and F1-score. The NL-RAN achieved the AUC of 0.9903, the precision of 0.9473, and the F1-score of 0.9462, surpass all the classification methods compared. The heat map output by the attention module is also clearer than the heat map output by CAM. Our experimental results indicate that our proposed method performs significantly better than existing methods. In addition, the first attention module outputs a heat map containing detailed outline information to increase the interpretability of the model. Our experiments indicate that the inference of our model is fast. It can provide real-time assistance with diagnosis.
BibTeX
@misc{yang2024explainable,
  author = {Jingfu Yang and Peng Huang and Jing Hu and Shu Hu and Siwei Lyu and Xin Wang and Jun Guo and Xi Wu},
  title = {{An Explainable Non-local Network for COVID-19 Diagnosis}},
  year = {2024},
  eprint = {2408.04300},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2408.04300},
}
Figure