Long-Term Treatment Effect Estimation via Surrogate Indices

This direction is merged into another direction: unobserved confounding (unmeasured confounding). Its last version stays readable and citable here.

Version 1 of 18 papers15 conceptsfrozen 2026-10-04

In fields ranging from medicine to economics and product development, the most important outcomes often take the longest to observe. A medical researcher might want to know if a drug increases 10-year survival rates; an economist might study whether a preschool program increases lifetime earnings; a software engineer at Netflix might want to know if a UI change increases long-term subscriber retention.

Waiting years for these results is often impractical. The traditional alternative—using a single "proxy" metric like 30-day blood pressure or 1-week click-through rate—is often misleading because these metrics don't capture the full complexity of the long-term goal.

The Surrogate Index framework, pioneered by Susan Athey, Guido Imbens, Raj Chetty, and Hyunseung Kang, provides a rigorous statistical bridge. It allows researchers to combine multiple short-term "surrogates" into a single index that predicts long-term effects with higher precision and much greater speed than direct measurement.

The Core Intuition: Denoising Through Projection

The most surprising finding in this research is that estimating an effect through a surrogate index can actually be more precise than measuring the long-term outcome directly.

In The Surrogate Index: Combining Short-Term Proxies to Estimate Long-Term Treatment Effects More Rapidly and Precisely, the authors explain that long-term outcomes are often "noisy." Over a decade, a person’s earnings are affected by thousands of random events—economic recessions, health shocks, or simple luck—that have nothing to do with the original intervention.

By using a surrogate index, you are essentially projecting the long-term outcome onto a set of intermediate variables (like early-career employment and wages). This process filters out the "idiosyncratic noise" of the long-term data, leaving only the "systematic signal" that is actually related to the treatment's path. As Athey et al. demonstrate in their 2016 work, this can reduce standard errors by over 30%, providing a more stable estimate of the true treatment effect.

How It Works: Fusing Two Data Sources

The framework typically requires two distinct datasets:

  1. The Experimental Sample: A randomized trial where the treatment is assigned. Here, we observe the treatment ($W$) and the short-term surrogates ($S$), but we haven't waited long enough to see the long-term outcome ($Y$).
  2. The Observational (Comparison) Sample: A larger, historical dataset where we observe both the surrogates ($S$) and the long-term outcome ($Y$), but no treatment was necessarily applied.

The "Surrogate Index" is the conditional expectation of the long-term outcome given the surrogates, $E[Y|S]$, calculated from the observational sample. Researchers then apply this index to the experimental sample. If the surrogates fully capture the pathway from treatment to outcome—a condition known as the surrogacy condition—then the difference in the Surrogate Index between the treated and control groups is a valid estimate of the long-term treatment effect.

Scaling to Real-World Decisions

This isn't just a theoretical tool for economists; it has immediate practical applications in high-velocity engineering environments. Vickie Zhang, Nathan Kallus, and colleagues tested this at scale in Evaluating the Surrogate Index as a Decision-Making Tool Using 200 A/B Tests at Netflix.

They found that an "auto-surrogate index" built on just 14 days of user behavior could predict the results of 63-day experiments with 95% alignment. For a company like Netflix, the ability to end experiments weeks early allows for a much higher volume of testing, which outweighs the slight risk of a surrogate-based error.

Expanding the Surrogate Concept

The power of using "proxies" to stabilize "gold-standard" data has recently expanded into other domains:

Summary

The Surrogate Index works because it recognizes that the "true" outcome is often a messy realization of a cleaner underlying process. By identifying the intermediate markers that sit on the causal path, researchers can ignore the noise of the future and focus on the signals of the present. Whether the surrogate is a 14-day streaming metric or an LLM-generated label, the goal remains the same: using abundant, immediate data to make more precise inferences about the things that matter in the long run.

Papers in this version

History & citationVersion 1 · 2026-10-04

Merged into another direction · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_long_term_treatment_effect_estimation_vi_beea2ad0,
  title = {Long-Term Treatment Effect Estimation via Surrogate Indices},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/long-term-treatment-effect-estimation-via-surrogate-indices/rdr_beea2ad022bf44869321e5836724949a},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}

This exact version (version 1, frozen text):

@misc{lacuna_long_term_treatment_effect_estimation_vi_beea2ad0_v1,
  title = {Long-Term Treatment Effect Estimation via Surrogate Indices},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/long-term-treatment-effect-estimation-via-surrogate-indices/rdr_beea2ad022bf44869321e5836724949a/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}