Model-based regression adjustment with model-free covariates for network interference

Kevin Han, Johan Ugander

TL;DR

Estimating causal effects in social networks is notoriously difficult because one person's treatment often "spills over" to their neighbors, violating standard statistical assumptions. This paper introduces ReFeX-LASSO, a clever automated procedure that mines a network's structure to discover these hidden interference patterns and uses them to produce significantly more accurate estimates of global treatment effects.

What Problem Does This Paper Address?

In a perfect world, researchers rely on the Stable Unit Treatment Value Assumption (SUTVA), which assumes that the treatment of one person doesn't affect the outcome of another. In reality, we live in networks. If your friend gets a discount code, a vaccine, or a new app, it likely changes your behavior—this is called network interference.

When interference exists, the standard "Difference-in-Means" (comparing the treated group to the control group) becomes biased. To fix this, researchers usually have to guess the "exposure mapping"—a mathematical model of how neighbors affect each other (e.g., "I am affected if at least 20% of my friends are treated"). If you guess the model wrong, your results are wrong. This paper tackles the challenge of estimating the Global Average Treatment Effect (GATE)—the difference between a world where everyone is treated versus a world where no one is—without having to guess the interference mechanism beforehand.

Methods

The authors propose a two-part framework:

  1. ReFeX-LASSO (Feature Generation & Selection):
    • Recursive Feature eXtraction (ReFeX): The algorithm starts with simple "base" features (e.g., how many of my friends are treated?). It then recursively aggregates these features from neighbors (e.g., "What is the average number of treated friends my friends have?"). This allows the model to capture complex, multi-hop interference (spillovers that travel through "a friend of a friend").
  2. LASSO: Because recursion can generate an overwhelming number of features, the authors use LASSO (a regression method that penalizes complexity) to automatically select only the most predictive features.
  3. Block Bootstrap (Inference):
    • Standard error estimation is hard in networks because data points aren't independent. The authors introduce a block bootstrap method. They partition the network into "clusters" or "blocks" using a $k$-hop-max clustering algorithm. By resampling these relatively independent clusters rather than individuals, they can construct reliable confidence intervals.

Datasets

The paper evaluates the method using two primary sources:

  • Facebook 100 (Swarthmore College): A real-world social network of 1,657 students and over 60,000 edges. The authors used this structure to run "semi-synthetic" experiments, where they knew the ground truth but used a complex, dense network to test the algorithm's limits.
  • Chinese Farmer Network (Cai et al., 2015): A real-world experimental dataset regarding weather insurance adoption in rural China. This dataset is a classic example of network interference, as farmers' decisions to buy insurance were heavily influenced by their social circles.

Key Insights and Ideas

  • "Model-Free" is the Goal: Most existing methods require an "oracle" to tell them how interference works. This paper shows that we can let the data speak for itself. By generating a massive library of potential graph features and letting LASSO prune them, the researcher doesn't have to be a "network whisperer."
  • Recursion Captures Complexity: The "aha moment" here is that complex, non-local interference can be represented as a series of local aggregations. You don't need a global view of the network to understand how a treatment might ripple through it; you just need to look at your neighbors' neighbors.
  • Sequential Selection Matters: The authors found that selecting features during the recursive process (ReFeX-LASSO) is much more stable and produces lower variance than generating all possible features first and selecting at the end (Post-ReFeX-LASSO).

Key Results

  • Accuracy: In simulations with complex interference (where effects travel 3+ hops), ReFeX-LASSO achieved a Root Mean Squared Error (RMSE) of 2.47, compared to a staggering 29.67 for the standard Difference-in-Means estimator.
  • Oracle Performance: Remarkably, the method performed nearly as well as—and sometimes better than—an "oracle" estimator that was told exactly which features to look for.
  • Real-World Utility: On the Chinese farmer dataset, the method successfully identified that the "number of treated neighbors" was the most critical feature, producing an effect estimate (0.178) that was more precise than previous adjustment methods.

Limitations and Future Work

  • Uniformity Assumption: The current work assumes a "Bernoulli design" (every unit has an independent probability of being treated). The authors acknowledge that extending this to "cluster randomized designs" (where whole villages are treated at once) is a difficult but necessary next step.
  • Linearity: The regression adjustment currently relies on linear models. While effective, the authors suggest that moving toward fully non-linear models (like deep learning or forest-based adjustments) using the same generated features could capture even more nuanced social dynamics.
  • Bootstrap Sensitivity: The block bootstrap depends on the network not being too dense. In extremely "hairball" networks where everyone is connected to everyone, finding well-isolated blocks remains a challenge.

Summary updated

Abstract

Abstract When estimating a global average treatment effect (GATE) under network interference, units can have widely different relationships to the treatment depending on a combination of the structure of their network neighborhood, the structure of the interference mechanism, and how the treatment was distributed in their neighborhood. In this work, we introduce a sequential procedure to generate and select graph- and treatment-based covariates for GATE estimation under regression adjustment. We show that it is possible to simultaneously achieve low bias and considerably reduce variance with such a procedure. To tackle inferential complications caused by our feature generation and selection process, we introduce a way to construct confidence intervals based on a block bootstrap. We illustrate that our selection procedure and subsequent estimator can achieve good performance in terms of root-mean-square error in several semi-synthetic experiments with Bernoulli designs, comparing favorably to an oracle estimator that takes advantage of regression adjustments for the known underlying interference structure. We apply our method to a real-world experimental dataset with strong evidence of interference and demonstrate that it can estimate the GATE reasonably well without knowing the interference process a priori .
BibTeX
@article{han2023model,
  author = {Kevin Han and Johan Ugander},
  title = {{Model-based regression adjustment with model-free covariates for network interference}},
  journal = {Journal of Causal Inference},
  year = {2023},
  doi = {10.1515/jci-2023-0005},
}

Loading related content...

Figure