Prediction of Major Depressive Disorder Following Beta-Blocker Therapy in Patients with Cardiovascular Diseases

Suho Jin, Kristin Kostka, Jose Posada, Yee-Suk Kim, Seung In Seo, Dong Yun Lee, Nigam H. Shah, Sungwon Roh, Young‐Hyo Lim, Sun Geu Chae, Uram Jin, Sang Joon Son, Christian Reich, Peter R. Rijnbeek, Rae Woong Park, Seng Chan YouJournal of Personalized Medicine 2020 · DOI

TL;DR

This paper presents a machine learning model that predicts the onset of major depressive disorder (MDD) in patients with cardiovascular disease (CVD) who are prescribed beta-blockers. The model, built using L1-regularized logistic regression, identifies key risk factors and achieves a respectable predictive performance, paving the way for personalized medicine approaches to mitigate adverse treatment effects.

What Problem Does This Paper Address?

Patients with cardiovascular disease (CVD) are already at a higher risk of developing depression compared to the general population. This depression, in turn, is linked to poorer prognoses and increased mortality. Beta-blockers are a common treatment for various CVDs, but there's a concern that they might be associated with an increased risk of depression. Early detection and intervention for depression in these vulnerable patients are crucial for improving their outcomes. However, the clinical predictors for this specific type of depression (i.e., depression occurring after starting beta-blocker therapy for CVD) are not well-established. This lack of clarity makes it difficult to proactively identify and support at-risk individuals. The paper aims to bridge this gap by developing a predictive model to stratify patients based on their risk of developing MDD after initiating beta-blocker therapy for CVD.

Methods

The core of this research lies in developing a machine learning model for predicting incident Major Depressive Disorder (MDD). The authors employed L1-regularized logistic regression as their primary modeling technique. This choice is significant because L1 regularization is known for its ability to perform feature selection, effectively identifying the most predictive variables from a large set of potential predictors and reducing model complexity. This is particularly useful in healthcare data, which can be very high-dimensional.

They also explored other machine learning algorithms, including random forest and gradient boosting machine, for comparison. However, L1-regularized logistic regression was favored due to its ability to significantly reduce the number of variables needed for prediction while maintaining comparable performance, aligning with the goal of creating a more parsimonious and interpretable model.

The model development followed a standardized framework, ensuring reproducibility and facilitating external validation. The process involved:

  • Data Preprocessing: Converting raw clinical data into a standardized OMOP Common Data Model (CDM) format.
  • Feature Engineering: Generating a large number of binary variables (yes/no) from clinical data (diagnoses, prescriptions, procedures) from a 365-day observation window prior to the index date. Age was used as a continuous variable.
  • Model Training: Training the L1-regularized logistic regression model on a large South Korean claims database.
  • Internal Validation: Splitting the training data into training (80%) and validation (20%) sets. Optimal parameters were determined through cross-validation.
  • External Validation: Testing the model's generalizability on six independent datasets from the USA and South Korea.

Datasets

The study utilized a combination of large-scale administrative claims databases and electronic health records (EHRs) for both model development and validation.

  • Development Dataset: The National Health Insurance Service-National Sample Cohort (NHIS-NSC) database from South Korea was used for training and internal validation. This dataset represents approximately 2.2% of the South Korean population and was followed for 11 years.
  • External Validation Datasets: Six independent datasets were used for external validation:
  • USA Datasets: * IQVIA US Ambulatory Electronic Medical Record (EMR): Longitudinal EHR data from ambulatory clients (2006-2020), covering over 40 million patients.
  • STAnford medicine Research data Repository (STARR)—Observational Medical Outcomes Partnership (OMOP): EHR data from various hospitals.
  • IQVIA OpenClaims: Pre-adjudicated medical and pharmacy claims data (2013-2020), covering over 200 million unique patients.
  • South Korea Datasets: * Ajou University Hospital: EHR data from a tertiary teaching hospital.
  • Hanyang University Hospital: EHR data from a tertiary teaching hospital.
  • Kangdong Sacred Heart Hospital: EHR data from a tertiary teaching hospital.

All datasets were converted to the OMOP Common Data Model (CDM) to ensure interoperability and facilitate standardized analysis.

Key Insights and Ideas

  • Non-selective beta-blockers as a significant predictor: The study highlights that the use of non-selective beta-blockers was the strongest predictor of incident MDD among the selected variables. This reinforces existing concerns about their potential impact on mood, even though the authors acknowledge the complexity and potential dilution of this effect over time with newer beta-blocker generations.
  • Anxiety and sleep disturbances are critical co-factors: Beyond the direct drug effect, the model strongly identified anxiety disorders and sleep problems as key risk factors. This suggests that pre-existing mental health vulnerabilities and sleep quality are crucial considerations when assessing MDD risk in CVD patients on beta-blockers.
  • Chronic diseases cluster with depression risk: The inclusion of various chronic diseases (gastrointestinal, musculoskeletal, rheumatic) as predictors underscores the interconnectedness of physical and mental health. Patients with CVD often have multiple comorbidities, and these chronic conditions appear to amplify the risk of developing depression.
  • Female sex as a consistent predictor: The model consistently identified female sex as a significant predictor of MDD. This aligns with epidemiological findings on sex differences in depression prevalence and onset, potentially related to behavioral, hormonal, or genetic factors.
  • The power of standardized data models for validation: The successful external validation across diverse datasets (both claims and EHRs, from different countries) demonstrates the robustness of the OMOP CDM and the standardized framework used in the study. This approach is crucial for building generalizable clinical prediction models.

Key Results

  • Model Performance: The L1-regularized logistic regression model achieved an Area Under the Receiver Operating Characteristic Curve (AUC) of 0.74 in internal validation.
  • External Validation: AUCs in external validation ranged from 0.62 to 0.71, indicating good generalizability across different data sources.
  • Key Predictors: The most significant predictors for incident MDD included:
  • Non-selective beta-blocker use
    • Anxiety disorder
    • Sleep problems
    • Female sex
    • Various chronic diseases (e.g., gastrointestinal, musculoskeletal)
  • Incidence Rates: The incidence of MDD within 365 days after initiating beta-blockers was 1.5% in the development cohort (774 out of 50,397 patients). Incidence rates in external validation sets varied, with some being significantly lower.
  • Variable Reduction: The L1 regularization successfully reduced the number of variables from over 10,000 to 74 in the final model, making it more efficient and interpretable.

Limitations and Future Work

The authors acknowledge several limitations:

  • Declining Use of Non-selective/Lipophilic Beta-blockers: The study's development database might reflect an older prescribing pattern. The decreasing use of these specific beta-blocker types could impact the model's future applicability.
  • Outcome Definition: The model relies solely on diagnosis codes for defining MDD, which might not capture the full spectrum or severity of depressive symptoms.
  • Causality: The study identifies predictors but does not establish a causal relationship between beta-blocker use and MDD. The association might be due to confounding factors or the underlying conditions for which beta-blockers are prescribed.

Future work could focus on:

  • Incorporating Severity: Developing models that predict not only the onset but also the severity of depression, given its strong link to prognosis.
  • Real-time Prediction: Integrating the model into clinical workflows for real-time risk assessment and early intervention.
  • Exploring Newer Beta-blockers: Investigating the relationship between newer generations of beta-blockers and depression risk.
  • Expanding Data Sources: Validating the model on even more diverse datasets to further confirm its generalizability.

Summary updated

Abstract

Incident depression has been reported to be associated with poor prognosis in patients with cardiovascular disease (CVD), which might be associated with beta-blocker therapy. Because early detection and intervention can alleviate the severity of depression, we aimed to develop a machine learning (ML) model predicting the onset of major depressive disorder (MDD). A model based on <i>L</i>1 regularized logistic regression was trained against the South Korean nationwide administrative claims database to identify risk factors for the incident MDD after beta-blocker therapy in patients with CVD. We identified 50,397 patients initiating beta-blockers for CVD, with 774 patients developing MDD within 365 days after initiating beta-blocker therapy. An area under the receiver operating characteristic curve (AUC) of 0.74 was achieved. A history of non-selective beta-blockers and factors related to anxiety disorder, sleeping problems, and other chronic diseases were the most strong predictors. AUCs of 0.62-0.71 were achieved in the external validation conducted on six independent electronic health records and claims databases in the USA and South Korea. In conclusion, an ML model that identifies patients at high-risk for incident MDD was developed. Application of ML to identify susceptible patients for adverse events of treatment may serve as an important approach for personalized medicine.
BibTeX
@article{jin2020prediction,
  author = {Suho Jin and Kristin Kostka and Jose Posada and Yee-Suk Kim and Seung In Seo and Dong Yun Lee and Nigam H. Shah and Sungwon Roh and Young‐Hyo Lim and Sun Geu Chae and Uram Jin and Sang Joon Son and Christian Reich and Peter R. Rijnbeek and Rae Woong Park and Seng Chan You},
  title = {{Prediction of Major Depressive Disorder Following Beta-Blocker Therapy in Patients with Cardiovascular Diseases}},
  journal = {Journal of Personalized Medicine},
  year = {2020},
  doi = {10.3390/jpm10040288},
}
Figure