Machine learning to predict rapid progression of carotid atherosclerosis in patients with impaired glucose tolerance

Xia Hu, Peter D. Reaven, Aramesh Saremi, Ninghao Liu, Mohammad Ali Abbasi, Huan Liu, Raymond Q. MigrinoEURASIP J. Bioinform. Syst. Biol 2016 · OpenReview

TL;DR

This paper introduces a machine learning framework to predict rapid progression of carotid atherosclerosis in individuals with impaired glucose tolerance (IGT). By combining feature selection with a Naïve Bayes classifier, the study demonstrates effective prediction on a relatively small clinical dataset, highlighting the potential of ML for risk stratification in prediabetic populations.

What Problem Does This Paper Address?

Prediabetes, characterized by impaired glucose tolerance (IGT), is a significant risk factor for type 2 diabetes and cardiovascular diseases, including atherosclerosis. Early identification of individuals with IGT who are likely to experience rapid progression of carotid atherosclerosis is crucial for timely intervention and improved risk management. However, traditional statistical methods often struggle with the complex, multi-modal nature of clinical data and the high dimensionality of variables. This paper aims to bridge this gap by applying machine learning techniques to predict rapid atherosclerosis progression in IGT patients.

Methods

The authors propose a general data-driven framework for predicting rapid carotid atherosclerosis progression. The core of their approach involves two key steps:

  1. Feature Selection: They employ the Fisher Score method to identify the most informative variables from a large set of demographic, clinical, and laboratory data. This supervised feature selection aims to reduce dimensionality and improve model performance by focusing on features that effectively discriminate between rapid and non-rapid progressors.
  2. Probabilistic Bayes-based Learning: A Naïve Bayes classifier is used for prediction. This model is chosen for its efficiency and its ability to handle multi-modal data, assuming conditional independence of features given the class label. The framework also includes data preprocessing steps like imputation for missing values and dummy variable creation for categorical features.

The performance of this approach is compared against other machine learning methods like Multilayer Perceptron (MLP) and Random Forest (RF), both with and without feature selection.

Datasets

The study utilizes data from the Actos Now for Prevention of Diabetes (ACT NOW) study. This dataset comprises 382 participants with impaired glucose tolerance (IGT) who underwent carotid intima-media thickness (CIMT) ultrasound measurements at baseline and again at 15-18 months. Participants were categorized into:

  • Rapid Progressors (RP): n = 39, with a CIMT change in the top decile (58.1 ± 17.5 μM).
  • Non-Rapid Progressors (NRP): n = 343, with a smaller CIMT change (5.8 ± 2.0 μM).

The dataset includes a wide array of demographic, clinical, and laboratory variables.

Key Insights and Ideas

  • ML for Small, Complex Clinical Datasets: The study demonstrates that machine learning, particularly with feature selection, can be effective even on relatively small clinical trial datasets, challenging the notion that ML is only suitable for "big data."
  • Feature Selection is Crucial: The results strongly suggest that feature selection significantly enhances the predictive performance of the machine learning models, making them more accurate and potentially more interpretable.
  • Naïve Bayes' Robustness: Despite the simplifying assumption of feature independence, the Naïve Bayes classifier, when combined with feature selection, outperformed more complex models like MLP and Random Forest in this specific prediction task. This highlights its practical utility in real-world scenarios where assumptions might not perfectly hold.
  • Domain Knowledge Integration: The paper touches upon the importance of incorporating domain knowledge (e.g., identifying redundant or irrelevant features) into the feature selection process, suggesting a path for more sophisticated model building.

Key Results

  • The Naïve Bayes classifier with feature selection achieved the highest performance, with an AUC of 0.797 and a Brier score of 0.085.
  • This model correctly classified 89.23% of subjects.
  • All three tested ML methods (Naïve Bayes, MLP, Random Forest) showed improved performance when feature selection was applied.
  • The study identified specific variables (e.g., hemoglobin, plasma creatinine, enrollment site, Hispanic ethnicity) that were significantly different between rapid and non-rapid progressors, providing insights into risk factors.

Limitations and Future Work

  • Generalizability: A key limitation acknowledged is the inability to definitively determine the generalizability of the derived ML models to other prediabetic groups or populations beyond the ACT NOW study cohort. This should be a focus of future research.
  • Domain Knowledge Integration: While domain knowledge was used to refine feature selection, the authors note that it's challenging to fully model and incorporate extensive physician knowledge into the framework, especially with a large number of initial variables.
  • Conditional Dependencies: The Naïve Bayes assumption of conditional independence of features is a simplification. Future work could explore more sophisticated probabilistic Bayesian models that can learn and model these conditional dependencies.
  • Extending the Framework: The authors suggest that the proposed framework is generalizable and can be extended to other data-driven problems in clinical research, provided a good understanding of the feature nature and appropriate clinician input for feature selection.

Summary updated

Abstract

Objectives Prediabetes is a major epidemic and is associated with adverse cardio-cerebrovascular outcomes. Early identification of patients who will develop rapid progression of atherosclerosis could be beneficial for improved risk stratification. In this paper, we investigate important factors impacting the prediction, using several machine learning methods, of rapid progression of carotid intima-media thickness in impaired glucose tolerance (IGT) participants. Methods In the Actos Now for Prevention of Diabetes (ACT NOW) study, 382 participants with IGT underwent carotid intima-media thickness (CIMT) ultrasound evaluation at baseline and at 15–18 months, and were divided into rapid progressors (RP, n = 39, 58 ± 17.5 μM change) and non-rapid progressors (NRP, n = 343, 5.8 ± 20 μM change, p < 0.001 versus RP). To deal with complex multi-modal data consisting of demographic, clinical, and laboratory variables, we propose a general data-driven framework to investigate the ACT NOW dataset. In particular, we first employed a Fisher Score-based feature selection method to identify the most effective variables and then proposed a probabilistic Bayes-based learning method for the prediction. Comparison of the methods and factors was conducted using area under the receiver operating characteristic curve (AUC) analyses and Brier score. Results The experimental results show that the proposed learning methods performed well in identifying or predicting RP. Among the methods, the performance of Naïve Bayes was the best (AUC 0.797, Brier score 0.085) compared to multilayer perceptron (0.729, 0.086) and random forest (0.642, 0.10). The results also show that feature selection has a significant positive impact on the data prediction performance. Conclusions By dealing with multi-modal data, the proposed learning methods show effectiveness in predicting prediabetics at risk for rapid atherosclerosis progression. The proposed framework demonstrated utility in outcome prediction in a typical multidimensional clinical dataset with a relatively small number of subjects, extending the potential utility of machine learning approaches beyond extremely large-scale datasets.
BibTeX
@article{hu2016machine,
  author = {Xia Hu and Peter D. Reaven and Aramesh Saremi and Ninghao Liu and Mohammad Ali Abbasi and Huan Liu and Raymond Q. Migrino},
  title = {{Machine learning to predict rapid progression of carotid atherosclerosis in patients with impaired glucose tolerance}},
  journal = {EURASIP J. Bioinform. Syst. Biol.},
  year = {2016},
  url = {https://openreview.net/forum?id=bulvTz7lhj},
}
Figure