Identification and estimation of treatment and interference effects in\n observational studies on networks

Laura Forastiere, Edoardo M. Airoldi, Fabrizia Mealli

TL;DR

This paper provides a rigorous framework for estimating causal effects when units are connected in a network, meaning one person's treatment can "spill over" to affect their neighbors. The authors introduce a novel semi-parametric estimator that uses generalized propensity scores to account for both individual and neighborhood-level confounding, effectively untangling direct treatment effects from network interference.

What Problem Does This Paper Address?

In standard causal inference, researchers usually rely on the Stable Unit Treatment Value Assumption (SUTVA), which assumes that the treatment of one individual does not affect the outcome of another. In the real world—think infectious diseases, social media marketing, or classroom learning—this assumption is often broken. This phenomenon is called interference or spillover effects.

While previous research has tackled interference in randomized experiments or within isolated groups ("partial interference"), doing so in observational studies on general networks is much harder. In these settings, we don't control who gets treated, and people often form connections with others similar to themselves (homophily). This creates a "confounding" nightmare where it's unclear if an outcome is due to a person's own treatment, their friends' treatment, or shared underlying characteristics.

Methods

The authors propose a new framework called SUTNVA (Stable Unit Treatment on Neighborhood Value Assumption). This relaxes SUTVA by allowing a unit's outcome to depend on their own treatment ($Z_i$) and a summary of their neighbors' treatments ($G_i$), such as the proportion of treated friends.

Key methodological contributions include:

  1. Analytical Bias Formulas: They derive exactly how much a "naive" estimator (which ignores the network) is biased. Crucially, they show that bias depends not just on the strength of the interference, but also on the correlation between individual and neighborhood treatments.
  2. Joint Propensity Scores: They define a propensity score that captures the probability of a specific "joint treatment" (your treatment + your neighbors' exposure) given your covariates.
  3. The Subclassification & GPS Estimator: To handle the complexity of bivariate treatment, they propose a two-step approach:
  4. Subclassification: Grouping units with similar individual propensity scores.
  5. Generalized Propensity Score (GPS): Within those groups, using a parametric model to adjust for the continuous/multi-valued neighborhood treatment.

Datasets

The authors validated their approach using a simulation study calibrated with real-world data from the Add Health dataset (National Longitudinal Study of Adolescent Health).

  • Scope: They used friendship networks from 29 schools, totaling 16,410 students.
  • Variables: They leveraged real covariates like race and grade level to create realistic scenarios of homophily and treatment assignment.
  • Scenarios: They tested four scenarios ranging from "independence" (where treatments are easy to disentangle) to "direct correlation" (where individual and neighborhood treatments are tightly linked).

Key Insights and Ideas

  • Bias isn't just about interference: A major "aha moment" is that ignoring interference doesn't always lead to massive bias. If the individual treatment and neighborhood treatment are conditionally independent, a naive estimator might still get the main effect right. The real danger arises when there is a residual association between your treatment and your friends' treatment (e.g., peer influence or homophily).
  • The "Joint" Nature of Treatment: The paper shifts the perspective from seeing interference as a nuisance to seeing it as a second, simultaneous treatment. By treating $(Z_i, G_i)$ as a bivariate treatment, they can apply and extend classical propensity score logic.
  • Balancing Properties: They prove that the joint propensity score acts as a "balancing score," meaning that units with the same score will have similar covariate distributions across different levels of network exposure.

Key Results

  • Accuracy: In simulations where naive regression models showed significant bias (e.g., bias values around -3.5 to -10.0), the proposed Subclassification & GPS estimator reduced the bias to near zero (often < 0.01).
  • Robustness: The estimator performed well even in "Scenario 4," the most difficult case where individual and neighborhood treatments were directly correlated.
  • Spillover Estimation: The method successfully estimated the "Dose-Response Function," showing how a student's health outcomes (like days missed due to illness) change as the proportion of their insured friends increases.

Limitations and Future Work

  • Known Network Assumption: The authors assume the network structure is perfectly known and fixed. In reality, social networks are often measured with error or change over time.
  • Model Dependence: While the approach is semi-parametric, the neighborhood adjustment still relies on the correctness of the chosen outcome model (e.g., a polynomial function).
  • Inference Challenges: Estimating standard errors on networks is notoriously difficult because units are not independent. The authors suggest a bootstrap approach but note that more work is needed for complex sampling designs.
  • Future Directions: The authors point toward developing sensitivity analyses for unobserved network confounders and exploring Bayesian semiparametric models to better quantify uncertainty.

Summary updated

Abstract

Causal inference on a population of units connected through a network often\npresents technical challenges, including how to account for interference. In\nthe presence of local interference, for instance, potential outcomes of a unit\ndepend on its treatment as well as on the treatments of other local units, such\nas its neighbors according to the network. In observational studies, a further\ncomplication is that the typical unconfoundedness assumption must be extended -\nsay, to include the treatment of neighbors, and indi- vidual and neighborhood\ncovariates - to guarantee identification and valid inference. Here, we propose\nnew estimands that define treatment and interference effects. We then derive\nanalytical expressions for the bias of a naive estimator that wrongly assumes\naway interference. The bias depends on the level of interference but also on\nthe degree of association between individual and neighborhood treatments. We\npropose an extended unconfoundedness assumption that accounts for interference,\nand we develop new covariate-adjustment methods that lead to valid estimates of\ntreatment and interference effects in observational studies on networks.\nEstimation is based on a generalized propensity score that balances individual\nand neighborhood covariates across units under different levels of individual\ntreatment and of exposure to neighbors' treatment. We carry out simulations,\ncalibrated using friendship networks and covariates in a nationally\nrepresentative longitudinal study of adolescents in grades 7-12, in the United\nStates, to explore finite-sample performance in different realistic settings.\n
BibTeX
@article{forastiere2020identification,
  author = {Laura Forastiere and Edoardo M. Airoldi and Fabrizia Mealli},
  title = {{Identification and estimation of treatment and interference effects in\textbackslash\{\}n observational studies on networks}},
  journal = {Journal of the American Statistical Association},
  year = {2020},
  doi = {10.1080/01621459.2020.1768100},
}
Figure