Conditional average treatment effect estimation with marginally constrained models

Wouter A. C. van Amsterdam, Rajesh Ranganath

TL;DR

This paper introduces Marginally Constrained Models (MCMs), a new way to estimate personalized treatment effects (CATE) by combining results from small clinical trials with large observational datasets. By correcting a common mathematical mismatch—where researchers mistakenly use "marginal" trial results as "conditional" model offsets—the authors provide a more accurate and statistically efficient tool for individualized medical decision-making.

What Problem Does This Paper Address?

In medicine, the "gold standard" for proof is the Randomized Controlled Trial (RCT). However, RCTs usually only tell us the Average Treatment Effect (ATE)—how well a drug works for the "average" person in the study. Doctors actually need the Conditional Average Treatment Effect (CATE)—how well it will work for this specific patient sitting in front of them.

RCTs are usually too small to calculate CATEs reliably. To solve this, researchers often turn to massive observational datasets (like electronic health records). A common shortcut is the "offset method": they take the relative effect (like an odds ratio) from a trial and "plug it in" as a fixed value while using the big data to learn individual risks.

The authors point out a major flaw here: non-collapsibility. In logistic models, the "marginal" odds ratio reported by a trial (the effect on the whole group) is mathematically different from the "conditional" odds ratio (the effect on a specific person). Using one for the other leads to biased, inconsistent estimates.

Methods

The authors propose a new estimator called the Marginally Constrained Model (MCM). Instead of forcing a specific parameter to match the trial result (the offset approach), they add a constraint (or regularizer) to the model’s objective function.

Key features include:

  • The Marginal Constraint: The model is allowed to learn individual variations from observational data, but it is "penalized" if its total predicted average effect doesn't match the marginal effect reported in the RCT.
  • Consistency: They prove that under standard causal inference assumptions (like "no unobserved confounding"), this approach is a consistent estimator of the true CATE.
  • CR-MCM: A variation called the Constant-Relative Marginally Constrained Model, which combines the marginal constraint with the assumption that the relative treatment effect is stable across different patient types.

Datasets

The paper relies on synthetic experimental grids rather than a single real-world benchmark. This allows the authors to precisely control variables like the strength of confounding, the amount of variation in treatment effects, and the degree of non-collapsibility.

  • They simulated binary outcomes and treatments across various parameter ranges (e.g., different baseline risks and treatment strengths).
  • Sample sizes for these simulations ranged from 50 to 750 to test statistical efficiency.

Key Insights and Ideas

  • The "Offset" Trap: The paper highlights that the popular "offset method" used in medical literature is fundamentally flawed for CATE estimation because it ignores non-collapsibility. Even if you have the "perfect" trial result, plugging it directly into a conditional model as an offset will give you the wrong answer.
  • Efficiency Gains: By using the trial result as a constraint rather than ignoring it, the MCM requires significantly less data. The authors found that an unconstrained model needs 71% to 106% more samples to reach the same level of confidence as the MCM.
  • Better than the Average: Even when there is "unobserved confounding" (hidden factors the data doesn't show), the authors show that using an MCM or an offset model is usually better for patients than just relying on the trial's ATE, provided there is enough real-world variation in how patients respond to treatment.

Key Results

  • Statistical Efficiency: In head-to-head tests, the MCM consistently produced narrower confidence intervals for CATE estimates compared to standard maximum-likelihood estimators.
  • Error Reduction: Using the Precision in Heterogeneous Treatment Effect (PEHE) metric, the authors demonstrated that the CR-MCM remains consistent and accurate even as the complexity of the patient population increases, whereas the standard offset method's error grows (see Figure 1 in the paper).
  • Robustness: In simulations with unobserved confounding, the MCM outperformed the "ATE-baseline" (just giving everyone the average effect) in over 90-99% of scenarios where the treatment effect had meaningful variation (see Table 4).

Limitations and Future Work

  • Simple Covariates: The current experiments focused on a single binary covariate. Real-world medical data is high-dimensional and messy; the authors note that the "efficiency gain" of the marginal constraint might decrease as the number of patient characteristics grows.
  • Transportability: The model assumes the trial population and the observational population are similar. If the trial was done on healthy 20-year-olds and the observational data is from 80-year-olds with multiple diseases, the marginal constraint might be misleading.
  • Uncertainty in Trials: The paper assumes the trial provides a "perfect" estimate of the marginal effect. Future work could incorporate Bayesian methods to account for the fact that trial results themselves have margins of error.

Summary updated

Abstract

Abstract Treatment effect estimates are often available from randomized controlled trials as a single average treatment effect for a certain patient population. Estimates of the conditional average treatment effect (CATE) are more useful for individualized treatment decision-making, but randomized trials are often too small to estimate the CATE. Examples in medical literature make use of the relative treatment effect (e.g. an odds ratio) reported by randomized trials to estimate the CATE using large observational datasets. One approach to estimating these CATE models is by using the relative treatment effect as an offset , while estimating the covariate-specific untreated risk. We observe that the odds ratios reported in randomized controlled trials are not the odds ratios that are needed in offset models because trials often report the marginal odds ratio. We introduce a constraint or a regularizer to better use marginal odds ratios from randomized controlled trials and find that under the standard observational causal inference assumptions, this approach provides a consistent estimate of the CATE. Next, we show that the offset approach is not valid for CATE estimation in the presence of unobserved confounding. We study if the offset assumption and the marginal constraint lead to better approximations of the CATE relative to the alternative of using the average treatment effect estimate from the randomized trial. We empirically show that when the underlying CATE has sufficient variation, the constraint and offset approaches lead to closer approximations to the CATE.
BibTeX
@article{amsterdam2023conditional,
  author = {Wouter A. C. van Amsterdam and Rajesh Ranganath},
  title = {{Conditional average treatment effect estimation with marginally constrained models}},
  journal = {Journal of Causal Inference},
  year = {2023},
  doi = {10.1515/jci-2022-0027},
}

Loading related content...

Figure