Estimating Brain Age with Global and Local Dependencies

Yanwu Yang, Xutao Guo, Zhikai Chang, Chenfei Ye, Yang Xiang, Haiyan Lv, Ting Ma

TL;DR

Researchers have developed a new deep learning architecture called the Global and Local Dependency Network (GLDN) to predict "brain age" from MRI scans with unprecedented accuracy. By combining the local feature extraction of CNNs with a novel "Successive Permuted Transformer" for global context, the model achieved a Mean Absolute Error (MAE) of just 2.91 years across a massive dataset of over 22,000 subjects.

What Problem Does This Paper Address?

In neurology, "brain age" is often different from chronological age. The Predicted Age Difference (PAD)—the gap between how old your brain looks on an MRI and how many years you’ve actually lived—is a potent biomarker. A "positive PAD" (a brain that looks older than it is) is frequently linked to cognitive impairment, brain injury, and neurodegenerative diseases like Alzheimer’s.

However, accurately estimating brain age is a "fine-grained" challenge. Traditional Convolutional Neural Networks (CNNs) are excellent at detecting local textures but often struggle to capture long-range spatial relationships across the entire 3D volume of the brain. Conversely, Vision Transformers (ViTs) excel at global context but can be computationally prohibitive for 3D data and may ignore important local correlations. This paper seeks to bridge that gap by capturing both local and global dependencies efficiently.

Methods

The authors introduce the Global and Local Dependency Network (GLDN), which utilizes a hybrid approach:

  1. Local Learning Block (LLB): Uses standard 3D CNN layers to encode densely distributed local features and strengthen "locality"—the idea that nearby voxels are highly related.
  2. Global Learning Block (GLB) / Successive Permuted Transformer (SPT): This is the core innovation. Instead of performing computationally expensive 3D self-attention, the SPT permutes the 3D brain volume into 2D slices from three different perspectives: Sagittal, Axial, and Coronal. It processes these views sequentially, allowing the model to "see" the whole 3D structure through a series of 2D operations, which is much more efficient.
  3. Fusion Blocks: These modules aggregate the outputs from the LLB and GLB at multiple stages, ensuring the model doesn't lose fine-grained detail while building a global map.
  4. Label Distribution Learning (LDL): Rather than treating age as a single number (regression), the model predicts a probability distribution. This accounts for the "ambiguity" in aging—the fact that a healthy 30-year-old brain might naturally share features with a 28-year-old or a 32-year-old brain.

Datasets

The study utilized an impressively large and diverse cohort of 22,645 healthy subjects aggregated from five major sources:

  • UK Biobank
  • ADNI (Alzheimer’s Disease Neuroimaging Initiative)
  • IXI Database
  • OASIS (Open Access Series of Imaging Studies)
  • 1000 Functional Connectomes Project (1000-FCP)

The subjects ranged in age from 14 to 97 years old, providing a comprehensive look at the human brain across the entire adult lifespan.

Key Insights and Ideas

  • The Hybrid Advantage: The authors found that neither CNNs nor Transformers are sufficient on their own. An ablation study showed that removing the CNN component (the "Ours w/o CNN" model) significantly degraded performance, proving that local "texture" is just as vital as global "structure" for brain aging.
  • Efficiency through Permutation: The Successive Permuted Transformer (SPT) solves the "3D problem" elegantly. By rotating the data and processing 2D slices, it captures 3D spatial relationships indirectly without the memory overhead of true 3D Transformers.
  • Soft Labels Matter: By using Label Distribution Learning (LDL) combined with expectation regression, the model handles the inherent noise in biological data better than simple mean-squared error approaches.

Key Results

The GLDN outperformed a wide array of state-of-the-art models, including specialized brain-age CNNs (like SFCN) and standard Transformers (like ViT):

  • Accuracy: Achieved a Mean Absolute Error (MAE) of 2.855 on the validation set and 2.911 on an independent test set.
  • Correlation: Showed a Pearson Correlation Coefficient (PCC) of 0.879, indicating a very high degree of linear relationship between predicted and actual age.
  • Comparison: For context, standard ResNet-34 achieved an MAE of 3.334, and a pure Vision Transformer (ViT) lagged behind at 3.536. The GLDN’s ability to integrate both scales of information was clearly the winning factor.

Limitations and Future Work

While the results are robust, the paper notes a few areas for growth:

  • Feature Plateau: The authors observed that adding too many CNN blocks eventually leads to a performance plateau, likely due to features becoming too abstract and losing low-level structural info.
  • Healthy vs. Diseased: This study focused on healthy subjects to establish a baseline. The next logical step is applying this high-accuracy model to clinical populations (e.g., patients with early-stage dementia) to see if the GLDN's superior accuracy translates into better diagnostic sensitivity.
  • Interpretability: While the model "locates" information, further work could involve visualizing exactly which brain regions (e.g., hippocampus vs. ventricles) the Transformer is prioritizing at different stages of life.

Summary updated

Abstract

The brain age has been proven to be a phenotype of relevance to cognitive performance and brain disease. Achieving accurate brain age prediction is an essential prerequisite for optimizing the predicted brain-age difference as a biomarker. As a comprehensive biological characteristic, the brain age is hard to be exploited accurately with models using feature engineering and local processing such as local convolution and recurrent operations that process one local neighborhood at a time. Instead, Vision Transformers learn global attentive interaction of patch tokens, introducing less inductive bias and modeling long-range dependencies. In terms of this, we proposed a novel network for learning brain age interpreting with global and local dependencies, where the corresponding representations are captured by Successive Permuted Transformer (SPT) and convolution blocks. The SPT brings computation efficiency and locates the 3D spatial information indirectly via continuously encoding 2D slices from different views. Finally, we collect a large cohort of 22645 subjects with ages ranging from 14 to 97 and our network performed the best among a series of deep learning methods, yielding a mean absolute error (MAE) of 2.855 in validation set, and 2.911 in an independent test set.
BibTeX
@inproceedings{yang2022estimating,
  author = {Yanwu Yang and Xutao Guo and Zhikai Chang and Chenfei Ye and Yang Xiang and Haiyan Lv and Ting Ma},
  title = {{Estimating Brain Age with Global and Local Dependencies}},
  booktitle = {ICIP},
  year = {2022},
  doi = {10.1109/icip46576.2022.9897454},
}

Loading related content...

Figure