A Survey on Causal Inference for Recommendation

Huishi Luo, Fuzhen Zhuang, Ruobing Xie, Hengshu Zhu, Deqing Wang, Zhulin An, Yongjun Xu

TL;DR

This paper provides a comprehensive, theory-driven survey of how causal inference is transforming recommender systems (RS). By moving beyond simple correlations to model cause-and-effect, researchers can now build systems that are more robust to bias, better at generalizing to new data, and capable of answering "what-if" counterfactual questions.

What Problem Does This Paper Address?

Traditional recommender systems are built on a statistical foundation that prioritizes correlation. If a user watches an action movie, the system assumes they like action movies. However, as the authors point out, "correlation is not causation." A user might watch a movie simply because it was trending (popularity bias) or because it was the only thing shown to them (exposure bias), not because of a genuine preference.

When RS models fail to distinguish between these factors, they learn "spurious correlations," leading to echo chambers, filter bubbles, and poor performance when the data distribution shifts. The core challenge addressed here is how to integrate formal causal frameworks to dissect these relationships, allowing systems to perform effective debiasing and answer counterfactual questions like, "Would the user have clicked if this item hadn't been trending?"

Fig. 1. Strengths of causal inference for recommendation.

Methods

The authors propose a novel taxonomy that categorizes over 120 papers based on their underlying causal theory rather than just the specific RS problem they solve.

Fig. 2. Strategies of the causal inference for recommendation.
  1. Potential Outcome (PO) Framework: Often used for policy evaluation, this framework treats recommendation as a "treatment" and the user's reaction as the "outcome." Key techniques include:
  2. Inverse Propensity Scoring (IPS): Re-weighting samples to account for selection bias.
  3. Doubly Robust (DR) Methods: Combining outcome modeling with propensity weighting to reduce variance and bias.
  4. Structural Causal Models (SCM): These use Directed Acyclic Graphs (DAGs) to explicitly map out how variables interact.
  5. Confounder Models: Addressing variables that affect both what is shown and what is clicked (e.g., user income).
  6. Mediator Models: Understanding indirect effects (e.g., a friend's purchase increasing trust, which then increases purchase probability).
  7. Collider Models: Handling cases where two independent causes lead to a single effect (e.g., user interest and item popularity both causing a click).
Fig. 4. Graphical models of three typical types of causal structures.
  1. General Counterfactual-based Methods: These leverage the "minimum change" intuition of counterfactuals for tasks like data augmentation (generating "what-if" training samples) and explainability.

Datasets

As this is a survey paper, it does not introduce a new dataset. Instead, it reviews research that typically utilizes standard industry benchmarks (e.g., MovieLens, Amazon, Taobao) alongside specialized "uniform" (randomly assigned) datasets used to validate debiasing techniques.

Key Insights and Ideas

  • The "Persuadable" User: Causal inference enables Uplift Modeling, which identifies users who only interact because of a recommendation. This allows platforms to avoid wasting resources on "voluntary buyers" who would have purchased the item anyway.
  • Debiasing as Deconfounding: Instead of just filtering out popular items, causal methods model popularity as a "confounder" in a DAG, allowing the system to mathematically "intervene" and estimate a user's true interest.
  • Beyond Accuracy: Counterfactuals are a natural fit for Fairness. By asking, "Would the recommendation change if the user's race or gender were different?", researchers can identify and mitigate algorithmic bias.
  • Data Augmentation: Counterfactual reasoning can create synthetic training data by imagining slight variations in user history that would lead to different outcomes, helping solve the data sparsity problem.

Key Results

The survey highlights a dramatic surge in interest in this field. As shown in the distribution of publications, the number of papers applying SCM and PO frameworks has grown exponentially since 2020.

Fig. 3. Distribution of publications on causal recommendations by year and framework, focusing exclusively on specific industrial algorithms and excluding fundamental theory discussions.

Qualitatively, the authors demonstrate that causal methods consistently outperform traditional collaborative filtering in "Out-of-Distribution" (OOD) scenarios—where the environment at test time differs from the training data.

Limitations and Future Work

Despite the promise, several hurdles remain:

  • Assumption Violations: Causal methods rely on assumptions like "positivity" (every user has a non-zero chance of seeing every item), which is almost never true in sparse, real-world RS data.
  • Causal Discovery: Most current methods require researchers to manually draw the causal graph. Automatically "discovering" these graphs from raw data is a major open research area.
  • Dynamic Loops: Recommender systems are feedback loops; today's recommendations become tomorrow's training data. Modeling these long-term, dynamic causal effects is significantly more complex than static modeling.
  • Foundation Models: Integrating causal reasoning into Large Language Models (LLMs) used for recommendation is a burgeoning frontier to ensure these powerful models remain fair and unbiased.

Summary updated

Abstract

Causal inference has recently garnered significant interest among recommender system (RS) researchers due to its ability to dissect cause-and-effect relationships and its broad applicability across multiple fields. It offers a framework to model the causality in recommender systems like confounding effects and deal with counterfactual problems such as offline policy evaluation and data augmentation. Although there are already some valuable surveys on causal recommendations, they typically classify approaches based on the practical issues faced in RS, a classification that may disperse and fragment the unified causal theories. Considering RS researchers' unfamiliarity with causality, it is necessary yet challenging to comprehensively review relevant studies from a coherent causal theoretical perspective, thereby facilitating a deeper integration of causal inference in RS. This survey provides a systematic review of up-to-date papers in this area from a causal theory standpoint and traces the evolutionary development of RS methods within the same causal strategy. Firstly, we introduce the fundamental concepts of causal inference as the basis of the following review. Subsequently, we propose a novel theory-driven taxonomy, categorizing existing methods based on the causal theory employed - namely, those based on the potential outcome framework, the structural causal model, and general counterfactuals. The review then delves into the technical details of how existing methods apply causal inference to address particular recommender issues. Finally, we highlight some promising directions for future research in this field. Representative papers and open-source resources will be progressively available at https://github.com/Chrissie-Law/Causal-Inference-for-Recommendation.
BibTeX
@misc{luo2023survey,
  author = {Huishi Luo and Fuzhen Zhuang and Ruobing Xie and Hengshu Zhu and Deqing Wang and Zhulin An and Yongjun Xu},
  title = {{A Survey on Causal Inference for Recommendation}},
  year = {2023},
  eprint = {2303.11666},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2303.11666},
}
Figure