Statistical inference of long-term causal effects in multiagent systems under the Neyman-Rubin model

Panos Toulis, David C. Parkes

Abstract

Planned experiments are the gold standard for reliably comparing the causal effect of switching from a baseline policy to a new policy. However, a critical shortcoming of classical experimental methods is that they typically do not account for the dynamic nature of responses to policy changes. In multiagent economies, such as ad auctions, agents adapt their bidding strategies in response to experimental pricing changes. Consequently, the causal effects after this adaptation period—the long-term causal effects—are not captured by classical methodology. We formalize a framework to define and estimate these effects by leveraging behavioral game theory to formulate necessary ignorability assumptions. Our approach combines a behavioral model of agent actions with a temporal model of behavior evolution.

Introduction

In modern digital economies like online ad auctions or ride-sharing platforms, policy changes rarely result in immediate, stable outcomes. Instead, they trigger a chain of adaptations as agents learn and optimize their strategies. Standard A/B testing, while effective for static environments, often fails here because it captures only the "transient" state immediately following a change.

The challenge is twofold. First, the Fundamental Problem of Causal Inference prevents us from observing the same agent under both treatment and control conditions simultaneously. Second, the Dynamical Problem means that short-term data does not represent the long-term steady-state value of a policy. Traditional econometric tools like Difference-in-Differences (DID) often rely on linear assumptions that break down when agents interact strategically.

The Latent Space Framework

To address these challenges, we propose a latent space approach that bridges the gap between short-term observations and long-term equilibrium.

Conceptual framework for inferring long-term causal effects from short-term observed data.

The framework relies on three core components:

  1. Behavioral Model: Instead of modeling raw actions, we model latent "behaviors" using Quantal Response models from behavioral game theory. This allows us to account for varying levels of strategic sophistication among agents.
  2. Temporal Model: A Vector Autoregressive (VAR(1)) model describes how these latent behaviors evolve over time as agents learn.
  3. The Pivot Assumption: We assume that at the start of an experiment ($t=0$), the distribution of behaviors is identical across groups because agents have not yet had time to react to their assignments. This "pivot" point allows us to extrapolate potential outcomes.

By formulating a "behavioral ignorability" assumption, we argue that while specific actions depend on experimental assignment, the underlying process of behavior evolution remains stable, enabling valid causal inference in the latent space.

Experimental Results

We validated this framework using the Rapoport and Boebel (1992) dataset, which involves human subjects playing zero-sum games. By treating different payoff matrices as distinct "policies" and holding out final periods of play as ground truth, we compared our Long-term Average Causal Effect (LACE) estimator against Naive and DID approaches.

The results demonstrated a significant improvement in accuracy. The LACE estimator achieved a Mean Squared Error (MSE) of 0.045, compared to 0.185 for the Naive approach and 0.361 for DID. This represents a 4x to 8x reduction in error, highlighting the value of injecting game-theoretic structure into the statistical model.

Discussion and Limitations

The primary insight of this work is that game theory can serve as a structural bridge for causal inference in complex systems. By modeling how agents should respond, we can make informed predictions about unobserved long-term states.

However, several limitations remain. The current model assumes a finite set of possible behaviors, and its accuracy depends heavily on the chosen game-theoretic model. Furthermore, the time horizon for "long-term" stabilization must be predefined. Future research will explore non-parametric behavior learning and more complex learning models, such as no-regret learning, to further refine these estimates.

Summary updated

Abstract

Planned experiments are the gold standard in reliably comparing the causal effect of switching from a baseline policy to a new policy. One critical shortcoming of classical experimental methods, however, is that they typically do not take into account the dynamic nature of response to policy changes. For instance, in an experiment where we seek to understand the effects of a new ad pricing policy on auction revenue, agents may adapt their bidding in response to the experimental pricing changes. Thus, causal effects of the new pricing policy after such adaptation period, the {\em long-term causal effects}, are not captured by the classical methodology even though they clearly are more indicative of the value of the new policy. Here, we formalize a framework to define and estimate long-term causal effects of policy changes in multiagent economies. Central to our approach is behavioral game theory, which we leverage to formulate the ignorability assumptions that are necessary for causal inference. Under such assumptions we estimate long-term causal effects through a latent space approach, where a behavioral model of how agents act conditional on their latent behaviors is combined with a temporal model of how behaviors evolve over time.
BibTeX
@inproceedings{toulis2016statistical,
  author = {Panos Toulis and David C. Parkes},
  title = {{Statistical inference of long-term causal effects in multiagent systems under the Neyman-Rubin model}},
  booktitle = {Digital},
  year = {2016},
}
Figure