A Novel Key Features Screening Method Based on Extreme Learning Machine for Alzheimer’s Disease Study

Jia Lü, Weiming Zeng, Lu Zhang, Yuhu ShiFrontiers in Aging Neuroscience 2022 · DOI

TL;DR

The paper introduces KFS-ELM, a novel feature screening method that prunes Extreme Learning Machines to identify and weight the most critical brain functional connections for Alzheimer's diagnosis. By filtering out over 3,000 "noisy" features from fMRI data, the researchers boosted diagnostic accuracy from 95.33% to a remarkable 99.20%.

What Problem Does This Paper Address?

Diagnosing Alzheimer’s Disease (AD) increasingly relies on high-dimensional neuroimaging data, specifically resting-state functional MRI (fMRI). Researchers use this data to map "functional connectivity"—essentially a mathematical representation of how different regions of the brain communicate with one another.

However, these maps are incredibly complex. A standard brain atlas can generate thousands of potential connections (features). The challenge is that many of these connections are redundant or even "negative" features that introduce noise and decrease the accuracy of machine learning models. Most existing classifiers act as "black boxes," making it difficult for clinicians to understand which specific brain connections are actually driving a diagnosis. The authors sought a way to prune these massive datasets down to the "key features" that truly matter.

Methods

The authors built their approach on the Extreme Learning Machine (ELM), a type of Single Hidden Layer Feedforward Neural Network known for its incredible speed because its input weights are assigned randomly rather than through tedious iteration.

The core innovation is the Key Features Screening (KFS-ELM) algorithm:

  1. Iterative Pruning: Instead of just using the ELM to classify, the algorithm iteratively removes input nodes (features) and hidden layer nodes.
  2. Accuracy Constraints: A feature is only kept if its removal would decrease the model's accuracy on validation sets.
  3. Weight Assignment: Because ELMs use random initializations, the authors ran the process multiple times (in a "Loop"). Features that were consistently selected across different runs were assigned higher weights, signifying their importance to the diagnosis.
  4. Feature Mapping: The final output is a weighted set of functional connections that can be mapped back onto a 3D model of the brain.

Datasets

The study utilized data from the ADNI2 project (Alzheimer’s Disease Neuroimaging Initiative):

  • Subjects: 200 total (100 Cognitively Normal individuals and 100 Alzheimer’s patients).
  • Preprocessing: fMRI data was processed using standard tools (DPARSF, SPM12) and mapped to the Automated Anatomical Labeling (AAL) atlas.
  • Feature Count: This resulted in 4,005 functional connectivity features per subject.

Key Insights and Ideas

  • The "Noise" is Real: One of the most striking findings was that out of 4,005 features, only 920 were identified as "key." The remaining 3,085 features actually had a negative effect on diagnosis. Removing them wasn't just about efficiency; it was essential for accuracy.
  • Rational Weighting: The weighting system proved highly logical. Features with higher weights (those selected most often by the algorithm) had a significantly higher individual impact on diagnostic performance than lower-weighted ones.
  • Biological Relevance: The screened features weren't just mathematical abstractions. They mapped to brain regions like the temporal cortex and fusiform gyrus—areas long associated with AD pathology—providing a bridge between AI and clinical neurology.

Key Results

  • Accuracy Jump: Using the full set of 4,005 features yielded a test accuracy of 95.33%. After screening down to the 920 key features, accuracy rose to 99.20%.
  • Model Compression: The pruning process drastically reduced the complexity of the network. The average number of hidden nodes dropped from 64,000 to roughly 1,042, making the final model much more efficient.
  • Top Biomarkers: The study identified specific high-weight connections, such as the link between the right fusiform gyrus (FFG.R) and the right superior temporal gyrus (STG.R), as primary indicators of the disease.

Limitations and Future Work

While the results are impressive, the authors acknowledge a few areas for growth:

  • Sample Size: The study used 200 subjects. While standard for fMRI research, larger datasets would help validate the generalizability of the 920 identified "key" features.
  • Linearity: The current ELM approach is essentially a linear transformation between the hidden and output layers. The authors suggest exploring Random Vector Functional Link (RVFL) networks in the future to handle potential non-linearities more effectively.
  • Broader Application: The KFS-ELM method is data-driven and not specific to Alzheimer's; the authors believe it could be applied to other high-dimensional medical diagnostic tasks or even other fields of study entirely.

Summary updated

Abstract

The Extreme Learning Machine (ELM) is a simple and efficient Single Hidden Layer Feedforward Neural Network(SLFN) algorithm. In recent years, it has been gradually used in the study of Alzheimer's disease (AD). When using ELM to diagnose AD based on high-dimensional features, there are often some features that have no positive impact on the diagnosis, while others have a significant impact on the diagnosis. In this paper, a novel Key Features Screening Method based on Extreme Learning Machine (KFS-ELM) is proposed. It can screen for key features that are relevant to the classification (diagnosis). It can also assign weights to key features based on their importance. We designed an experiment to screen for key features of AD. A total of 920 key functional connections screened from 4005 functional connections. Their weights were also obtained. The results of the experiment showed that: (1) Using all (4,005) features to diagnose AD, the accuracy is 95.33%. Using 920 key features to diagnose AD, the accuracy is 99.20%. The 3,085 (4,005 - 920) features that were screened out had a negative effect on the diagnosis of AD. This indicates the KFS-ELM is effective in screening key features. (2) The higher the weight of the key features and the smaller their number, the greater their impact on AD diagnosis. This indicates that the KFS-ELM is rational in assigning weights to the key features for their importance. Therefore, KFS-ELM can be used as a tool for studying features and also for improving classification accuracy.
BibTeX
@inproceedings{lu2022novel,
  author = {Jia Lü and Weiming Zeng and Lu Zhang and Yuhu Shi},
  title = {{A Novel Key Features Screening Method Based on Extreme Learning Machine for Alzheimer’s Disease Study}},
  booktitle = {Frontiers in Aging Neuroscience},
  year = {2022},
  doi = {10.3389/fnagi.2022.888575},
}
Figure