Bridging Interpretability and Performance: Enhanced Machine Learning-Based Prediction of Hematoma Expansion Post-Stroke via Comprehensive Feature Selection

Beigeng Zhao, Rui Song, Xu Guo, Lizhi YuIEEE Access 2023 · DOI

Abstract

Monitoring and controlling the occurrence of hematoma expansion (HE) events after a stroke is a primary clinical focus. While machine learning (ML) offers intelligent decision support, the "black box" nature of these models and the redundancy in medical data pose significant challenges. This paper proposes a methodology for comprehensive feature selection across diverse medical data and evaluates various ML models. Experiments on a real-world post-stroke HE dataset demonstrate that pruning features to an optimal subset (10–25 variables) enhances performance and interpretability, providing clinicians with a clear basis for decision-making.

Introduction

Hemorrhagic stroke is a critical medical emergency where the first few hours are decisive for patient outcomes. A major risk factor for poor prognosis is hematoma expansion (HE), a condition where bleeding continues to grow, increasing intracranial pressure and causing further neurological damage. While machine learning (ML) models excel at identifying patterns in complex datasets to predict HE, they face two significant hurdles in clinical settings: the "black box" problem and data redundancy.

Clinicians are often hesitant to rely on models that do not provide a transparent rationale for their predictions. Furthermore, medical records often contain a "double-edged sword" of information—rich data mixed with noise and redundant features that can degrade model performance. This study addresses these challenges by proposing a framework that bridges the gap between high predictive accuracy and clinical trust through rigorous feature selection and visualization.

Methodology

The researchers implemented a multi-stage pipeline designed to identify the most potent subset of features for HE prediction. The approach is divided into three core strategies:

Comprehensive Feature Selection

The study compared two main categories of selection techniques to identify the most informative variables:

  • Statistical-based techniques: These include Pearson correlation, ANOVA, and Chi-Squared tests, which evaluate the relationship between individual features and the target outcome.
  • Model-based techniques: These include Recursive Feature Elimination (RFE), Lasso/Ridge regression, and Tree-based importance, which utilize the internal logic of ML algorithms to rank feature utility.

Diverse Modeling and Ensembling

A wide array of classifiers was evaluated to ensure a robust comparison. These included Logistic Regression, Random Forests, Support Vector Machines (SVM), and Neural Networks. To maximize robustness and predictive stability, ensemble methods such as Stacking and Voting classifiers were used to combine the strengths of multiple individual models.

Interpretability and Visualization

To demystify the model's logic, the study employed SHAP (Shapley Additive exPlanations) values. This method quantifies the contribution of each feature to a specific prediction, allowing clinicians to see which factors (e.g., hematoma volume or blood pressure) drove a particular result. Additionally, visual heatmaps were created to illustrate how model performance fluctuates as features are added or removed, providing a clear roadmap for clinicians to understand the trade-offs between complexity and accuracy.

Dataset and Features

The study utilized a real-world dataset from the "20th China Post-Graduate Mathematical Contest in Modeling," consisting of 160 meticulously curated and anonymized patient cases.

The initial dataset included 42 attributes covering:

  • Demographics: Age, gender.
  • Medical History: Hypertension, diabetes, and other comorbidities.
  • Lifestyle Factors: Smoking and alcohol consumption.
  • Structured Imaging Data: Quantitative volumes and locations of hematoma and edema across various brain regions, such as the Anterior Cerebral Artery (ACA), Middle Cerebral Artery (MCA), and Posterior Cerebral Artery (PCA).

Unlike many deep learning studies that process raw CT scan pixels, this dataset uses structured quantitative details extracted from images. This format is highly representative of the tabular data found in electronic health records, making the findings directly applicable to standard clinical workflows.

Key Insights and Results

The experimental results yielded several critical insights into the relationship between data complexity and model performance.

The "Sweet Spot" of Complexity

The most striking finding was the identification of an "optimal performance plateau." Using all 42 features consistently led to suboptimal results due to overfitting and noise. The models achieved peak performance when the feature set was pruned to between 10 and 25 variables. This underscores a vital principle in medical ML: "less is often more."

Performance Benchmarks

The study demonstrated that feature pruning significantly improved predictive power:

  • Top Performer: An SVM model using RFE with 20 features achieved the best balance, reaching an ROC_AUC of 0.78.
  • Efficiency: Logistic Regression achieved a respectable 0.77 ROC_AUC using only 10 features selected via RFE.
  • Accuracy Peaks: Random Forest models reached an accuracy of 0.82 with just 10 features (selected via the ReliefF algorithm), outperforming versions trained on the full dataset.

Clinician Consensus

The researchers surveyed 31 clinicians without ML backgrounds to evaluate the interpretability of the framework. There was a unanimous consensus that the visualizations—specifically the feature ranking heatmaps and SHAP explanations—significantly bolstered their understanding of the model's decision-making process, fostering the trust necessary for clinical adoption.

Discussion and Future Work

While the results are promising, the authors acknowledge certain limitations. The study relied on a relatively small sample size of 160 cases; larger datasets are needed to further validate the generalizability of the feature rankings. Additionally, the current model uses tabular data; future iterations could integrate raw neuroimaging processing (via Convolutional Neural Networks) directly into the feature selection framework. Finally, moving from a "snapshot" prediction to dynamic, time-series forecasting would further enhance clinical utility by predicting when expansion might occur.

Conclusion

This research provides a robust methodology for enhancing both the performance and transparency of HE prediction models. By identifying the "sweet spot" of feature complexity and providing intuitive visualizations, the framework offers a path forward for integrating machine learning into the high-stakes environment of stroke management.

Summary updated

Abstract

Monitoring and controlling the occurrence of hematoma expansion events after a stroke is a primary clinical focus. The introduction of machine learning (ML) techniques offers intelligent decision support for physicians in this domain. However, for doctors without an ML background, the behavior of a hematoma expansion predictor seems opaque, similar to a "black box." Moreover, the vast and diverse set of features typically present in medical data acts as a double-edged sword: while encapsulating rich information with potential value, it also includes redundant details that offer little to predictive utility. Comprehensive feature selection is crucial, but many current state-of-the-art hematoma expansion prediction studies based on ML often overlook this step. In this paper, we propose a methodology tailored for comprehensive feature selection across diverse and abundant medical data features and rigorously evaluate ML models. Through experiments on a real-world post-stroke hematoma expansion prediction dataset, we demonstrate the efficacy of our approach in enhancing the performance of ML predictors. Visualization of the associated feature selection process and results further bolsters physicians’ understanding of the model’s decision-making basis, thereby strengthening its interpretability.
BibTeX
@inproceedings{zhao2023bridging,
  author = {Beigeng Zhao and Rui Song and Xu Guo and Lizhi Yu},
  title = {{Bridging Interpretability and Performance: Enhanced Machine Learning-Based Prediction of Hematoma Expansion Post-Stroke via Comprehensive Feature Selection}},
  booktitle = {IEEE Access},
  year = {2023},
  doi = {10.1109/access.2023.3348244},
}
Figure