The DeCAMFounder: nonlinear causal discovery in the presence of hidden variables

Raj Agrawal, Chandler Squires, Neha Prasad, Caroline UhlerJournal of the Royal Statistical Society Series B (Statistical Methodology) 2023 · DOI

TL;DR

This paper introduces DeCAMFounder, a novel method for discovering causal relationships in data with unobserved confounders and non-linear relationships. It achieves this by first estimating the confounding variation using spectral decomposition and then using this estimate to learn the causal graph, showing improved performance over existing methods on both simulated and real-world datasets.

What Problem Does This Paper Address?

In many real-world scenarios, we want to understand causal relationships between variables (e.g., in biology or economics). However, traditional causal discovery methods often assume that all relevant variables are observed. This assumption is frequently violated in practice, as unobserved variables (confounders) can create spurious correlations, making it difficult to infer true causal links. While some methods handle unobserved confounders, they often assume linear relationships. Conversely, methods that handle non-linear relationships typically assume no unobserved confounders. This paper tackles the challenging problem of causal discovery in the presence of both non-linear relationships and pervasive unobserved confounders, where these confounders influence many observed variables.

Methods

The core of DeCAMFounder lies in its ability to estimate the confounding variation. The authors propose a two-step approach:

  1. Estimating Confounding Variation: They leverage spectral decomposition (specifically, Principal Component Analysis or PCA) on the observed data matrix to estimate a set of "sufficient statistics" that capture the variation explained by the unobserved confounders. This is a key innovation, as it allows for the estimation of confounding effects even when the confounders themselves are not observed.
  2. Causal Discovery with a Novel Score Function: Using the estimated confounding variation, DeCAMFounder constructs a new score function. This score function is designed to evaluate the quality of potential causal graphs (DAGs) by considering the learned causal structure among the observed variables, while accounting for the estimated confounding effects. The authors then use this score function to search for the most likely causal graph.

The method builds upon the concept of "canonical exogenous DAGs" and assumes a causal additive model (CAM) framework, where variables are functions of their parents plus additive noise.

Datasets

  • Simulated Data: The authors generate synthetic datasets to evaluate their method under various conditions, including different strengths of confounding, linear and non-linear causal structures, and varying numbers of observed variables.
  • Real Data: The ovarian cancer RNA-seq dataset is used for empirical evaluation. This dataset consists of gene expression data and has known transcription factors (TFs) that can act as confounders. The authors remove the TFs to simulate the presence of unobserved confounders and use prior biological knowledge for partial validation.

Key Insights and Ideas

  • Spectral Decomposition for Confounders: The paper demonstrates that PCA on the observed data can effectively isolate and estimate the variation attributable to pervasive unobserved confounders, even without direct observation of these confounders. This is a powerful technique for dealing with latent variables.
  • Accounting for Non-linearity and Confounding Simultaneously: DeCAMFounder's strength lies in its ability to handle both non-linear relationships and unobserved confounders, a combination that is particularly challenging for existing methods.
  • "Spikiness" of Eigenvalues as a Signal: The authors show that the presence of pervasive confounders leads to "spiked" eigenvalues in the covariance matrix of the observed data. This spikiness is a key indicator that can be exploited by spectral methods.
  • Robustness to the Number of Confounders: The performance of DeCAMFounder appears to be more sensitive to the strength of confounding (i.e., the total variation explained by confounders) than to the exact number of unobserved confounders, suggesting a degree of robustness.

Key Results

  • Provable Consistency: The paper provides theoretical guarantees that DeCAMFounder can consistently recover the correct partial ordering of the causal graph under certain conditions.
  • Improved Performance: Empirical evaluations on both simulated and real-world data show that DeCAMFounder outperforms existing methods, particularly in settings with non-linear relationships and pervasive confounding. This improvement is evident in tasks like parent set selection and overall DAG recovery.
  • Effective Confounder Estimation: The method successfully estimates confounding variation, as demonstrated by its performance on the ovarian cancer dataset where estimated confounding correlates well with known transcription factors.

Limitations and Future Work

  • Assumption of Additive Noise: The method relies on the causal additive model (CAM) assumption, which might not hold in all real-world scenarios.
  • High-Dimensionality Requirements: Consistent estimation of confounding statistics requires specific conditions on the number of samples (N) and observed variables (p), such as N = o(p²) and p = o(exp(N)).
  • Future Work: The authors suggest exploring methods to handle selection bias, which is another common challenge in causal discovery. They also mention extending the theoretical guarantees to handle model misspecification more broadly.

Summary updated

Abstract

Abstract Many real-world decision-making tasks require learning causal relationships between a set of variables. Traditional causal discovery methods, however, require that all variables are observed, which is often not feasible in practical scenarios. Without additional assumptions about the unobserved variables, it is not possible to recover any causal relationships from observational data. Fortunately, in many applied settings, additional structure among the confounders can be expected. In particular, pervasive confounding is commonly encountered and has been utilised for consistent causal estimation in linear causal models. In this article, we present a provably consistent method to estimate causal relationships in the nonlinear, pervasive confounding setting. The core of our procedure relies on the ability to estimate the confounding variation through a simple spectral decomposition of the observed data matrix. We derive a DAG score function based on this insight, prove its consistency in recovering a correct ordering of the DAG, and empirically compare it to previous approaches. We demonstrate improved performance on both simulated and real datasets by explicitly accounting for both confounders and nonlinear effects.
BibTeX
@article{agrawal2023decamfounder,
  author = {Raj Agrawal and Chandler Squires and Neha Prasad and Caroline Uhler},
  title = {{The DeCAMFounder: nonlinear causal discovery in the presence of hidden variables}},
  journal = {Journal of the Royal Statistical Society Series B (Statistical Methodology)},
  year = {2023},
  doi = {10.1093/jrsssb/qkad071},
}
Figure