Efficient Estimation of Average Treatment Effect on the Treated under Endogenous Treatment Assignment

Trinetri Ghosh, Menggang Yu, Jiwei ZhaoarXiv 2023 · DOI · arXiv

This paper, recently published by researchers from the University of Wisconsin-Madison, tackles one of the "holy grails" of causal inference: estimating treatment effects when we can't observe everything that influences the decision to treat.

TL;DR

The authors develop a new framework to estimate the Average Treatment Effect on the Treated (ATT) when treatment assignment is "endogenous" (biased by unobserved factors). By leveraging "shadow variables"—factors related to the outcome but not the treatment decision—they provide a semiparametrically efficient estimator that eliminates the bias found in traditional methods.

What Problem Does This Paper Address?

In an ideal world, we would use randomized controlled trials (RCTs) to determine if a drug or policy works. In the real world, we often have to rely on observational data. The standard assumption in these studies is "unconfoundedness"—the idea that we have measured every variable that affects both the treatment and the outcome.

However, treatment assignment is often endogenous. For example, in cancer care, a doctor might choose a specific radiation therapy over surgery based on a "gut feeling" about a patient's frailty—a factor not perfectly captured in a database. If this unobserved frailty also affects survival, standard estimates will be biased.

While Instrumental Variables (IVs) are the classic solution to endogeneity, they are notoriously difficult to find. An IV must affect the treatment but have no direct relationship with the outcome. This paper flips the script by using Shadow Variables (SVs).

Methods

The core innovation is the formalization of Shadow Variables for ATT estimation.

1. The Shadow Variable (SV)

An SV ($Z$) is defined by two conditions:

  1. It is independent of the treatment assignment ($T$) given the untreated outcome ($Y_0$) and other observed covariates ($U$).
  2. It is related to the untreated outcome ($Y_0$), often through unmeasured confounders.

Think of it as the "anti-instrument." While an IV is a "helper" for the treatment side, an SV is a "helper" for the outcome side.

2. Semiparametric Efficiency

The authors don't just provide a way to identify the effect; they find the most mathematically "efficient" way to estimate it. They characterize the Efficient Influence Function (EIF). This allows them to create an estimator ($\hat{\Delta}_{eff}$) that has the lowest possible variance among a broad class of consistent estimators.

3. Flexible Nuisance Estimation

The framework is designed for the modern era. It allows researchers to use machine learning (like Random Forests or XGBoost) to estimate "nuisance" parts of the model (like the distribution of outcomes) while still maintaining rigorous statistical guarantees for the final treatment effect estimate.

Datasets

  • Simulated Data: The authors ran extensive simulations (n=600) to compare their method against "naive" estimators that ignore endogeneity.
  • National Cancer Database (NCDB): They applied the method to a real-world dataset of 7,233 stage T2 lung cancer patients. They compared Stereotactic Body Radiation Therapy (SBRT) against the standard surgical procedure (lobectomy).

Key Insights and Ideas

  • SDOH as Shadow Variables: The authors argue that Social Determinants of Health (SDOH), like income level or insurance type, are excellent candidates for SVs. While these factors certainly correlate with survival outcomes, they should not (clinically) drive a surgeon's technical decision between radiation and surgery.
  • The "Selection on Outcomes" Proof: In their lung cancer analysis, the authors statistically proved that the treatment decision was dependent on the potential untreated outcome. This confirms that the "strong ignorability" assumption used in most previous studies was likely invalid.
  • Efficiency Gain: The paper demonstrates that while a simple estimator ($\hat{\Delta}_{alt}$) works, the efficient version ($\hat{\Delta}_{eff}$) significantly reduces the margin of error, making the results much more reliable for policy decisions.

Key Results

  • Bias Correction: In simulations, naive methods (which assume no unobserved confounding) were heavily biased. The proposed SV estimators yielded almost zero bias.
  • The SBRT "Mirage": In the lung cancer study, naive methods suggested that SBRT provided a significant 5-31% boost in 3-year survival. However, once the authors accounted for endogeneity using their SV method, the effect vanished for the majority of patients (those with a comorbidity score of 0).
  • Clinical Reality: The results suggest that the "benefit" of SBRT seen in other observational studies might actually just be selection bias—doctors were choosing the treatment for patients who were already likely to have different survival trajectories.

Limitations and Future Work

  • The Completeness Condition: The math relies on a "conditional completeness" assumption. While standard in econometrics, it is a technical requirement that can be difficult to verify purely from data.
  • Parametric Treatment Model: While the outcome models can be nonparametric (ML-based), the treatment assignment model in this paper still relies on a parametric form (like a logistic regression).
  • SV Selection: Like IVs, the validity of a Shadow Variable depends on domain expertise. If the SV actually does influence the treatment decision directly, the estimator could become biased. Future work could involve sensitivity analyses for "near-shadow" variables.

Summary updated

Abstract

In this paper, we consider estimation of average treatment effect on the treated (ATT), an interpretable and relevant causal estimand to policy makers when treatment assignment is endogenous. By considering shadow variables that are unrelated to the treatment assignment but related to interested outcomes, we establish identification of the ATT. Then we focus on efficient estimation of the ATT by characterizing the geometric structure of the likelihood, deriving the semiparametric efficiency bound for ATT estimation and proposing an estimator that can achieve this bound. We rigorously establish the theoretical results of the proposed estimator. The finite sample performance of the proposed estimator is studied through comprehensive simulation studies as well as an application to our motivating study.
BibTeX
@misc{ghosh2023efficient,
  author = {Trinetri Ghosh and Menggang Yu and Jiwei Zhao},
  title = {{Efficient Estimation of Average Treatment Effect on the Treated under Endogenous Treatment Assignment}},
  year = {2023},
  eprint = {2307.01908},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2307.01908},
}
Figure