Prediction of Coronary Artery Calcium Score Using Machine Learning in a Healthy Population

Jong‐Seok Lee, Jae‐Sung Lim, Younggi Chu, Changhee Lee, Ohk‐Hyun Ryu, Hyun Hee Choi, Yong Soon Park, Chulho KimJournal of Personalized Medicine 2020 · DOI

TL;DR

This study explores the use of machine learning (ML) algorithms to predict high coronary artery calcium scores (CACS) in a healthy population, using only routine health examination data. The findings suggest that advanced ML models like XGBoost significantly outperform traditional binary logistic regression, offering a more accurate and potentially more accessible tool for early cardiovascular disease risk assessment.

What Problem Does This Paper Address?

Coronary artery calcium score (CACS) is a crucial indicator of future cardiovascular disease (CVD) risk. While CT-based deep learning methods have shown promise in predicting CACS from imaging, there's a gap in understanding the efficacy of machine learning algorithms using readily available clinical and laboratory data for predicting high CACS in a healthy, general population. Current risk stratification tools often rely on more complex assessments or are developed for symptomatic patients. This paper aims to bridge this gap by investigating whether ML models, beyond standard binary logistic regression (BLR), can effectively predict high CACS using only data from regular health screenings.

Methods

The researchers conducted a retrospective observational study using data from participants who underwent regular health screenings, including coronary CT angiography. They defined "high CACS" as an Agatston score of 100 or more.

The core of their methodology involved comparing three classification algorithms:

  • Binary Logistic Regression (BLR): A standard statistical method for binary classification.
  • CatBoost: An open-source gradient boosting library designed to handle categorical features effectively.
  • XGBoost (Extreme Gradient Boosting): A highly optimized and widely used gradient boosting library known for its speed and performance.

The dataset was split into training (70%) and testing (30%) sets, with stratification to ensure proportional representation of high CACS cases in both. All ML models were trained using 5-fold cross-validation and hyperparameter optimization via grid search to prevent overfitting and ensure robust performance. The primary metric for evaluating the models' predictive power was the Area Under the Receiver Operating Characteristic (AUROC) curve.

Datasets

The study utilized a dataset of 2133 participants who underwent regular health screenings and coronary CT angiography at three tertiary academic centers between January 2014 and December 2019. The input features for the ML models included anthropometric measures (age, sex, blood pressure, body mass index) and laboratory parameters (complete blood count, liver and renal function tests, lipid profile, atherosclerosis markers, and diabetes screening tests). Notably, clinical risk factors like hypertension, diabetes, dyslipidemia, and smoking were not included as direct input features, as their effects were assumed to be captured by the laboratory parameters.

Key Insights and Ideas

  • Beyond Imaging: The study highlights that valuable predictive insights for CACS can be extracted from routine clinical and laboratory data, potentially reducing reliance on more resource-intensive imaging techniques for initial risk stratification.
  • ML Superiority: Advanced ML algorithms like XGBoost demonstrate a significant advantage over traditional BLR in predicting high CACS, suggesting that complex, non-linear relationships within the data are better captured by these methods.
  • Feature Importance: Age, systolic blood pressure, and LDL cholesterol emerged as consistently important predictors across all ML models, aligning with established CVD risk factors. However, the study also revealed that ML models can identify other potentially overlooked features.
  • The "Healthy" Population Nuance: The finding that high CACS individuals had lower total and LDL cholesterol than low CACS individuals is counterintuitive and warrants further investigation, possibly related to statin use or other primary prevention strategies in this healthy cohort.

Key Results

  • Predictors: In multivariable BLR, age (OR 1.12), male sex (OR 2.93), systolic blood pressure (OR 1.02), and LDL cholesterol (OR 1.00) were significant predictors of high CACS.
  • Performance:
    • XGBoost achieved the highest AUROC of 0.823.
  • CatBoost followed with an AUROC of 0.750.
  • Binary Logistic Regression (BLR) had an AUROC of 0.585.
  • The performance difference between XGBoost and BLR was statistically significant (p < 0.001).

Limitations and Future Work

The authors acknowledge several limitations:

  • Drug Usage Data: The study did not include information on drug usage (e.g., statins) or regular exercise. This is a significant limitation, especially given the counterintuitive finding regarding LDL cholesterol, and suggests that future work should incorporate this data.
  • Generalizability: The study was conducted on a Korean population, and its findings may not be directly generalizable to other ethnic groups.
  • Selection Bias: Participants were recruited from tertiary hospitals, potentially introducing selection bias, even though the focus was on healthy individuals.

Future work could focus on:

  • Incorporating drug history and lifestyle factors into ML models.
  • Validating these ML models in diverse ethnic populations.
  • Exploring the interpretability of ML models to uncover novel biological pathways or risk indicators.
  • Investigating the potential for these ML models to be integrated into routine health screening workflows.

Summary updated

Abstract

Background: Coronary artery calcium score (CACS) is a reliable predictor for future cardiovascular disease risk. Although deep learning studies using computed tomography (CT) images to predict CACS have been reported, no study has assessed the feasibility of machine learning (ML) algorithms to predict the CACS using clinical variables in a healthy general population. Therefore, we aimed to assess whether ML algorithms other than binary logistic regression (BLR) could predict high CACS in a healthy population with general health examination data. Methods: This retrospective observational study included participants who had regular health screening including coronary CT angiography. High CACS was defined by the Agatston score ≥ 100. Univariable and multivariable BLR was performed to assess predictors for high CACS in the entire dataset. When performing ML prediction for high CACS, the dataset was randomly divided into a training and test dataset with a 7:3 ratio. BLR, catboost, and xgboost algorithms with 5-fold cross-validation and grid search technique were used to find the best performing classifier. Performance comparison of each ML algorithm was evaluated with the area under the receiver operating characteristic (AUROC) curve. Results: A total of 2133 participants were included in the final analysis. Mean age and proportion of male sex were 55.4 ± 11.3 years and 1483 (69.5%), respectively. In multivariable BLR analysis, age (odds ratio [OR], 1.12; 95% confidence interval [CI], 1.10–1.15, p &lt; 0.001), male sex (OR, 2.91; 95% CI, 1.57–5.38, p &lt; 0.001), systolic blood pressure (OR, 1.02; 95% CI, 1.00–1.03, p = 0.019), and low-density lipoprotein cholesterol (OR, 1.00; 95% CI, 0.99–1.00, p = 0.047) were significant predictors for high CACS. Performance in predicting high CACS of xgboost was AUROC of 0.823, followed by catboost (0.750) and BLR (0.585). The comparison of AUROC between xgboost and BLR was significant (p for AUROC comparison &lt; 0.001). Conclusions: Xgboost ML algorithm was found to be a more reliable predictor of CACS in healthy participants compared to the BLR algorithm. ML algorithms may be useful for predicting CACS with only laboratory data in healthy participants.
BibTeX
@article{lee2020prediction,
  author = {Jong‐Seok Lee and Jae‐Sung Lim and Younggi Chu and Changhee Lee and Ohk‐Hyun Ryu and Hyun Hee Choi and Yong Soon Park and Chulho Kim},
  title = {{Prediction of Coronary Artery Calcium Score Using Machine Learning in a Healthy Population}},
  journal = {Journal of Personalized Medicine},
  year = {2020},
  doi = {10.3390/jpm10030096},
}
Figure