Probabilistic Cause-of-Death Assignment Using Verbal Autopsies

Tyler H. McCormick, Zehang Li, Clara Calvert, Amelia C. Crampin, Kathleen Kahn, Samuel J. Clark

TL;DR

InSilicoVA is a new hierarchical Bayesian framework that automates the assignment of causes of death in regions where medical certification is unavailable. By treating physician-provided symptom rankings as priors rather than fixed values and sharing uncertainty between individual assignments and population-level trends, it provides more accurate and "honest" mortality estimates than previous algorithmic methods.

What Problem Does This Paper Address?

In many parts of the world, especially in impoverished nations, the majority of deaths occur at home without a doctor present. This leads to a "scandal of invisibility": fewer than one-third of deaths worldwide are assigned a formal cause. To fill this gap, researchers use Verbal Autopsies (VA)—standardized interviews with the decedent’s caregivers about signs and symptoms preceding death.

The challenge lies in translating these interviews into data. Traditionally, physicians manually reviewed VAs (expensive and slow) or used tools like InterVA. However, InterVA relies on arbitrary numerical probabilities assigned to physician "tendencies" (e.g., "Always" = 1.0, "Common" = 0.5) and fails to provide valid measures of uncertainty. This paper introduces InSilicoVA to provide a statistically rigorous, automated, and probabilistic alternative.

Methods

The authors propose a hierarchical Bayesian model that simultaneously estimates individual causes of death and the population-level Cause-Specific Mortality Fraction (CSMF).

Key innovations include:

  • Learning Probabilities from Rankings: Instead of using fixed, arbitrary probabilities for symptoms (like InterVA), InSilicoVA uses physician-provided rankings (letter grades) as a starting point. It then uses a truncated Beta prior to "learn" the actual probabilities from the data while maintaining the expert-defined order.
  • Uncertainty Sharing: The model is "modular," meaning it shares information between the likelihood of an individual’s cause of death and the overall distribution of causes in the population.
  • Physician Bias Correction: The framework includes a sub-model to incorporate VAs that have been manually coded by physicians. It uses an Expectation-Maximization (EM) algorithm to estimate and adjust for individual physician biases (e.g., one doctor might be more prone to over-diagnosing malaria than another).
  • Sampling: Inference is performed using a Metropolis-within-Gibbs algorithm, making it computationally feasible even for large datasets (up to $10^5$ deaths).

Datasets

The paper evaluates the model using three primary sources:

  1. PHMRC Gold Standard Dataset: Roughly 7,000 hospital deaths across six sites (India, Philippines, Tanzania, Mexico) where the cause was confirmed by laboratory or pathology findings.
  2. Agincourt HDSS (South Africa): Data on 9,875 adult deaths from a rural health and demographic surveillance system.
  3. Karonga HDSS (Malawi): Data on 1,469 adult deaths, including cases reviewed by multiple physicians to test the bias-correction model.

Key Insights and Ideas

  • The "Honesty" of Uncertainty: One of the most striking insights is that InSilicoVA is more "conservative" than previous methods. In real-world settings (Agincourt and Karonga), it assigns more deaths to "other/unspecified" categories. The authors argue this is a feature, not a bug: it reflects the inherent weakness of VA data rather than forcing a precise (but likely wrong) diagnosis.
  • Gold Standards Aren't Universal: The authors demonstrate that "gold standard" datasets from hospitals don't always generalize to home deaths. Symptom-cause associations change across geography and time, necessitating a model that can adapt to local data.
  • Modularity: By allowing the inclusion of physician-coded data and adjusting for their specific tendencies, the model bridges the gap between traditional manual review and modern machine learning.

Key Results

  • Superior Accuracy: In head-to-head comparisons using the PHMRC gold standard, InSilicoVA consistently outperformed InterVA and other algorithmic methods (like Tariff and SSP) in both CSMF accuracy and individual cause assignment.
  • Robustness: The model proved robust to how the initial rankings were constructed (e.g., "Quantile" vs. "Default" priors), suggesting it successfully recovers the underlying signal from the data.
  • Physician Variability: The bias-correction model revealed substantial variability in how different physicians code the same death, particularly for non-communicable diseases, highlighting the need for the model's de-biasing step.

Limitations and Future Work

  • Conditional Independence: Like its predecessors, InSilicoVA assumes symptoms are independent given a cause. This ignores "constellations" of symptoms (comorbidities) that physicians often use for diagnosis. The authors suggest future work could use factorizations or projections to model these interactions.
  • Questionnaire Burden: Current VA questionnaires are long and taxing for grieving families. The authors propose using item-response theory or active learning to create "dynamic" questionnaires that ask only the most relevant questions for a specific case.
  • Sampling Weights: For national-level estimates, the model would need to be adjusted for sampling weights, which are currently difficult to construct in many developing nations.

Reference: McCormick, T. H., et al. (2015). Probabilistic Cause-of-death Assignment using Verbal Autopsies. arXiv:1411.3042v3 [stat.AP].

Summary updated

Abstract

In regions without complete-coverage civil registration and vital statistics systems there is uncertainty about even the most basic demographic indicators. In such regions the majority of deaths occur outside hospitals and are not recorded. Worldwide, fewer than one-third of deaths are assigned a cause, with the least information available from the most impoverished nations. In populations like this, verbal autopsy (VA) is a commonly used tool to assess cause of death and estimate cause-specific mortality rates and the distribution of deaths by cause. VA uses an interview with caregivers of the decedent to elicit data describing the signs and symptoms leading up to the death. This paper develops a new statistical tool known as <i>InSilicoVA</i> to classify cause of death using information acquired through VA. InSilicoVA shares uncertainty between cause of death assignments for specific individuals and the distribution of deaths by cause across the population. Using side-by-side comparisons with both observed and simulated data, we demonstrate that InSilicoVA has distinct advantages compared to currently available methods.
BibTeX
@article{mccormick2016probabilistic,
  author = {Tyler H. McCormick and Zehang Li and Clara Calvert and Amelia C. Crampin and Kathleen Kahn and Samuel J. Clark},
  title = {{Probabilistic Cause-of-Death Assignment Using Verbal Autopsies}},
  journal = {Journal of the American Statistical Association},
  year = {2016},
  doi = {10.1080/01621459.2016.1152191},
}

Loading related content...

Figure