Incorporating Task-Specific Structural Knowledge into CNNs for Brain Midline Shift Detection

Maxim Pisov, Mikhail Goncharov, Nadezhda Kurochkina, Sergey Morozov, Victor Gombolevskiy, Valeria Chernina, Anton Vladzymyrskyy, Ksenia Zamyatina, Anna Chesnokova, Igor Pronin, Michael Shifrin, Mikhail Belyaev

Introduction

In clinical neurology, the "midline" is the imaginary line separating the two hemispheres of the brain. When a pathology—such as a tumor, stroke, or traumatic brain injury—causes pressure, it can push the brain to one side, resulting in a Midline Shift (MLS). Measuring this shift is vital for prognosis and surgical planning. While the American College of Radiology has highlighted the need for automated MLS estimation, it remains a difficult task for standard AI. Traditional computer vision methods are often brittle, while standard Convolutional Neural Networks (CNNs) struggle because MLS requires comparing distant anatomical landmarks, a task made difficult by the translation-invariant nature of standard convolutions.

Visualization of Brain Midline Shift (MLS) detection and measurement (14 mm) on MRI slices.

Methodology

The researchers proposed a "two-headed" CNN architecture that incorporates structural knowledge about brain anatomy directly into the model's design, using a U-Net backbone with Residual Blocks.

  1. Midline Estimation Head: Instead of standard segmentation, the authors use Softmax-based coordinate prediction. By assuming exactly one horizontal coordinate ($x$) represents the midline for every vertical coordinate ($y$), the network produces a probability distribution. The final prediction is the expected value of this distribution, allowing for sub-pixel accuracy and differentiability.
  2. Limits Prediction Head: Not every slice of a brain scan contains a clear midline (e.g., the very top or bottom of the skull). This second head predicts the vertical "limits" (the $y$-range) where the midline is actually present.

This approach is inherently interpretable: the model draws the predicted midline on the scan, allowing for radiologist verification. Furthermore, because the midline head outputs a probability distribution, the model can calculate 95% confidence intervals, signaling to doctors when the AI is "unsure."

Experimental Setup

The study utilized two distinct datasets to ensure accuracy and robustness:

  • DS1 (Clinical/Pathological): 352 MRI series from a neurosurgery hospital involving severe brain damage (64% with significant MLS ≥ 5mm). This was used for training and 5-fold cross-validation.
  • DS2 (Routine Practice): 203 MRI series from an out-patient clinic representing "routine" scans (only 8% with significant MLS). This served as an external validation set.

The data included various modalities (T1, T2, and FLAIR) and different voxel spacings to test generalization across hardware and settings.

Key Results and Insights

The proposed method significantly outperformed a standard ResNet-152 regression model across all metrics:

  • Accuracy: On the difficult DS1 dataset, the proposed model achieved a Mean Absolute Error (MAE) of 1.54 mm, compared to 2.92 mm for the standard ResNet. On the external DS2 dataset, the MAE dropped to 0.75 mm.
  • Detection: For identifying "significant" shift (≥ 5mm), the model achieved an Area Under the ROC Curve (AUC) of 0.95 on the primary dataset.
  • Human-Level Performance: The model’s error rates were comparable to inter-expert variability between human doctors.

By enforcing structural priors (e.g., one midline point per row), the researchers simplified the search space, leading to higher accuracy than general-purpose architectures. The ability to generate confidence intervals is a major step toward clinical trust, as the "widening" of the predicted midline visually alerts users to potential errors in highly deformed regions.

Conclusion

While the model achieves human-level performance, it still faces challenges in "dubious" cases, such as when a tumor is located directly in the middle of the brain or distorts the longitudinal fissure. Future work will focus on adapting this method for CT scans, which are the more common modality for emergency trauma cases.

Summary updated

Abstract

Midline shift (MLS) is a well-established factor used for outcome prediction in traumatic brain injury, stroke and brain tumors. The importance of automatic estimation of MLS was recently highlighted by ACR Data Science Institute. In this paper we introduce a novel deep learning based approach for the problem of MLS detection, which exploits task-specific structural knowledge. We evaluate our method on a large dataset containing heterogeneous images with significant MLS and show that its mean error approaches the inter-expert variability. Finally, we show the robustness of our approach by validating it on an external dataset, acquired during routine clinical practice.
BibTeX
@inproceedings{pisov2019incorporating,
  author = {Maxim Pisov and Mikhail Goncharov and Nadezhda Kurochkina and Sergey Morozov and Victor Gombolevskiy and Valeria Chernina and Anton Vladzymyrskyy and Ksenia Zamyatina and Anna Chesnokova and Igor Pronin and Michael Shifrin and Mikhail Belyaev},
  title = {{Incorporating Task-Specific Structural Knowledge into CNNs for Brain Midline Shift Detection}},
  booktitle = {iMIMIC/ML-CDS @ MICCAI},
  year = {2019},
  doi = {10.1007/978-3-030-33850-3\_4},
}
Figure