Interpretable Machine Learning for COVID-19: An Empirical Study on Severity Prediction Task

Han Wu, Wenjie Ruan, Jiangtao Wang, Dingchang Zheng, Shaolin Li, Jian Chen, Kunwei Li, Xiangfei Chai, Sumi HelalarXiv 2020 · DOI · OpenReview

TL;DR

This paper tackles the critical challenge of deploying high-accuracy but "black-box" machine learning models in COVID-19 diagnosis by focusing on interpretability. By applying various model-agnostic interpretation techniques to different ML models, they identify key biomarkers associated with COVID-19 severity, offering valuable insights for medical practitioners.

What Problem Does This Paper Address?

The core problem is the "black-box" nature of many powerful machine learning models. While these models can achieve high accuracy in tasks like predicting disease severity, their lack of transparency makes it difficult for medical professionals to trust and adopt them. In the high-stakes, time-sensitive environment of a pandemic like COVID-19, this trust deficit can hinder the effective use of AI. The authors aim to bridge this gap by making these models interpretable, revealing the underlying reasons for their predictions and identifying significant biomarkers that might have been overlooked.

Methods

The researchers employed a suite of model-agnostic interpretation methods to understand the predictions of four different machine learning models: Decision Tree, Random Forest, Gradient Boosted Trees, and Neural Networks. These methods include:

  • Permutation Feature Importance: Measures how much a model's performance degrades when a feature's values are randomly shuffled.
  • Partial Dependence Plot (PDP): Shows the marginal effect of one or two features on the predicted outcome.
  • Individual Conditional Expectation (ICE): Similar to PDP but shows the effect for each individual instance.
  • Accumulated Local Effects (ALE): Averages the effect of a feature across local regions, reducing bias from correlated features.
  • Local Interpretable Model-agnostic Explanations (LIME): Explains individual predictions by approximating the black-box model locally with an interpretable one.
  • Shapley Additive Explanation (SHAP): A game-theory approach to attribute the prediction to each feature.

They also used faithfulness and monotonicity as metrics to evaluate the quality of these interpretations.

Datasets

The study utilized two primary datasets:

  1. Zhuhai, China Dataset: A smaller dataset of 92 patients with confirmed SARS-CoV-2 laboratory tests collected between January 18, 2020, and March 5, 2020. This dataset was used for initial model training and interpretation.
  2. Kaggle Dataset (Hospital Israelita Albert Einstein, São Paulo, Brazil): A much larger, open dataset comprising 5644 confirmed COVID-19 patients. This dataset was used for validation of their approach.

Key Insights and Ideas

  • Biomarkers for Severity: The study successfully identified key biomarkers associated with COVID-19 severity. This is crucial because it provides actionable insights for clinicians.
  • Consistency Across Models: Remarkably, different interpretation methods and models often converged on similar important features, lending credibility to the findings.
  • The Power of Interpretability in a Crisis: The paper highlights how interpretability is not just an academic exercise but a vital tool for rapid response during health crises, allowing for quicker identification of critical indicators.
  • Elderly Patients at Higher Risk: The analysis revealed that older age is a significant factor associated with more severe COVID-19 outcomes, a finding corroborated by the data.
  • Symptom vs. Test Results: The study showed that some models (like Decision Trees) might over-rely on the presence of symptoms, while more advanced models (Gradient Boosted Trees, Neural Networks) prioritize objective test results, leading to more robust predictions, especially for identifying future severity.

Key Results

  • Initial Dataset (Zhuhai): Interpretation revealed that an increase in N-Terminal pro-Brain Natriuretic Peptide (NTproBNP), C-Reaction Protein (CRP), and lactic dehydrogenase (LDH), along with a decrease in lymphocyte (LYM) count, are associated with severe COVID-19 infection and increased risk of death.
  • Validation Dataset (Kaggle): Applying the same interpretation methods to the larger Kaggle dataset identified leukocytes, eosinophils, and platelets as three indicative biomarkers for COVID-19 severity.
  • Model Performance: Gradient Boosted Trees and Neural Networks achieved the highest precision on the test set, correctly identifying all severe patients in their smaller test set.
  • Interpretation Evaluation: The study found that SHAP generally provided higher faithfulness scores than LIME, though monotonicity evaluation showed mixed results across methods.

Limitations and Future Work

  • Data Sparsity: The initial dataset suffered from data sparsity due to the varied nature of medical tests ordered for patients.
  • Monotonicity Evaluation: The paper notes that monotonicity evaluation yielded "False" for most interpretation methods, suggesting that while features are important, their contribution might not always be strictly monotonic. This points to an area for further research in developing better evaluation metrics for interpretability.
  • Generalizability of Interpretation: While the study validated findings on a second dataset, the authors acknowledge that interpreting models for entirely new viruses at the early stages of an outbreak might have less existing medical research to corroborate the findings.
  • Future Work: The authors suggest that their interpretable machine learning approach can serve as a warning system, prompting patients and doctors to pay closer attention to health conditions, especially when model predictions align with medical knowledge but the patient feels otherwise. They also emphasize the need for continued research into better evaluation metrics for interpretability.

Summary updated

Abstract

The black-box nature of machine learning models hinders the deployment of some high-accuracy models in medical diagnosis. It is risky to put one's life in the hands of models that medical researchers do not fully understand. However, through model interpretation, black-box models can promptly reveal significant biomarkers that medical practitioners may have overlooked due to the surge of infected patients in the COVID-19 pandemic. This research leverages a database of 92 patients with confirmed SARS-CoV-2 laboratory tests between 18th Jan. 2020 and 5th Mar. 2020, in Zhuhai, China, to identify biomarkers indicative of severity prediction. Through the interpretation of four machine learning models, decision tree, random forests, gradient boosted trees, and neural networks using permutation feature importance, Partial Dependence Plot (PDP), Individual Conditional Expectation (ICE), Accumulated Local Effects (ALE), Local Interpretable Model-agnostic Explanations (LIME), and Shapley Additive Explanation (SHAP), we identify an increase in N-Terminal pro-Brain Natriuretic Peptide (NTproBNP), C-Reaction Protein (CRP), and lactic dehydrogenase (LDH), a decrease in lymphocyte (LYM) is associated with severe infection and an increased risk of death, which is consistent with recent medical research on COVID-19 and other research using dedicated models. We further validate our methods on a large open dataset with 5644 confirmed patients from the Hospital Israelita Albert Einstein, at S\~ao Paulo, Brazil from Kaggle, and unveil leukocytes, eosinophils, and platelets as three indicative biomarkers for COVID-19.
BibTeX
@misc{wu2020interpretable,
  author = {Han Wu and Wenjie Ruan and Jiangtao Wang and Dingchang Zheng and Shaolin Li and Jian Chen and Kunwei Li and Xiangfei Chai and Sumi Helal},
  title = {{Interpretable Machine Learning for COVID-19: An Empirical Study on Severity Prediction Task}},
  year = {2020},
  eprint = {2010.02006},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2010.02006},
}
Figure