Causal Discovery of Linear Cyclic Models from Multiple Experimental Data Sets with Overlapping Variables

Antti Hyttinen, Frederick Eberhardt, Patrik O. Hoyer

TL;DR

This paper tackles the challenge of inferring causal relationships from multiple, potentially incomplete, experimental and observational datasets. They introduce novel algorithms that can combine these diverse data sources to uncover the underlying linear cyclic causal structure, even when variables are not consistently measured across all experiments. This work is crucial for synthesizing knowledge from fragmented scientific investigations.

What Problem Does This Paper Address?

Scientific research often involves multiple studies investigating the same phenomena. These studies might use different sets of variables, some overlapping, and some might be purely observational while others involve experimental interventions. Integrating these disparate data sources to build a comprehensive understanding of the underlying causal structure is a significant challenge. Existing methods often struggle with:

  • Overlapping but incomplete data: Datasets don't always measure the same set of variables.
  • Mixed data types: Combining passive observational data with experimental intervention data.
  • Cyclic relationships: The possibility of feedback loops in the causal structure, which complicates traditional acyclic assumptions.
  • Latent confounders: The presence of unmeasured common causes that can distort observed relationships.

This paper aims to bridge this gap by developing methods that can robustly infer linear cyclic causal models from such fragmented, overlapping experimental and observational data.

Methods

The authors propose two main algorithmic approaches:

  • BILIN (Bilinear Inference): This method tackles the problem by overparameterizing the search space, treating both direct effects (elements of the matrix B) and total effects (elements of the matrix T) as unknowns. It then formulates a bilinear system of equations and uses an alternating optimization approach to find solutions. This method can incorporate constraints derived from experimental effects and some faithfulness assumptions.
  • LININF (Linear Inference): This algorithm takes a more direct approach by focusing on linear constraints on experimental effects. It leverages the fact that while some experimental effects are directly observed, others can be inferred or constrained through relationships derived from faithfulness assumptions and the structure of interventions across different datasets. This method is described as consistent, though potentially incomplete as it doesn't exploit all non-linear relationships.

Both methods build upon the assumption of faithfulness, which posits that observed independences in the data are not coincidental but reflect the absence of causal paths. They also assume linear cyclic models and allow for latent confounders. A key contribution is the formalization of identifiability conditions for such models, establishing when the true causal structure can be uniquely determined from the available data.

Datasets

The paper does not introduce new datasets. Instead, it uses simulated data for evaluation. The simulations are designed to mimic the scenario of overlapping experimental and observational data sets, with varying numbers of samples per experiment and an "infinite sample limit" to assess asymptotic behavior.

Key Insights and Ideas

  • Synthesizing fragmented knowledge: The core idea is that by combining information from multiple, diverse experiments, we can infer causal relationships that would be impossible to detect from any single dataset alone.
  • Faithfulness in experimental settings: The paper extends the concept of faithfulness, traditionally used in observational settings, to experimental data, enabling stronger inferences about the absence of causal links.
  • Linear constraints are powerful: Even with the complexity of cyclic models and latent confounders, linear constraints derived from experimental effects and faithfulness assumptions can significantly restrict the space of possible causal models.
  • Underdetermination is common: Despite the proposed methods, the paper acknowledges that substantial underdetermination of causal links often remains, especially for variables not measured together in any experiment.

Key Results

The paper presents two algorithms, BILIN and LININF, and evaluates their performance against a baseline (EHS) that does not assume faithfulness.

  • Identifiability Conditions: Necessary and sufficient conditions for full model identifiability are derived, highlighting the importance of having experiments that cover all pairs of variables.
  • Performance Comparison: Simulations show that both BILIN and LININF, which assume faithfulness, generally outperform the EHS baseline, particularly in identifying causal links.
  • BILIN vs. LININF: BILIN shows good accuracy in predicting absent edges but struggles with predicting present links. LININF is presented as a more consistent approach, extracting more information from faithfulness constraints, especially for identifying causal links.
  • Underdetermination: The results consistently show that a significant portion of causal links remain underdetermined, even with the proposed methods.

Limitations and Future Work

  • Incompleteness of LININF: LININF is consistent but incomplete, as it does not exploit all non-linear equations that could arise from faithfulness.
  • Sensitivity to Independence Tests: Inferences based on faithfulness can be sensitive to the accuracy of statistical independence tests, especially in finite sample settings.
  • No Confounding Detection: The current methods focus on inferring the causal structure and do not explicitly detect or infer the presence of latent confounders.
  • Future Work: The authors suggest developing a more complete version of LININF that can incorporate non-linear faithfulness constraints. They also highlight the need for a better understanding of the inherent underdetermination in overlapping data settings.

Summary updated

Abstract

Much of scientific data is collected as randomized experiments intervening on some and observing other variables of interest. Quite often, a given phenomenon is investigated in several studies, and different sets of variables are involved in each study. In this article we consider the problem of integrating such knowledge, inferring as much as possible concerning the underlying causal structure with respect to the union of observed variables from such experimental or passive observational overlapping data sets. We do not assume acyclicity or joint causal sufficiency of the underlying data generating model, but we do restrict the causal relationships to be linear and use only second order statistics of the data. We derive conditions for full model identifiability in the most generic case, and provide novel techniques for incorporating an assumption of faithfulness to aid in inference. In each case we seek to establish what is and what is not determined by the data at hand.
BibTeX
@inproceedings{hyttinen2012causal,
  author = {Antti Hyttinen and Frederick Eberhardt and Patrik O. Hoyer},
  title = {{Causal Discovery of Linear Cyclic Models from Multiple Experimental Data Sets with Overlapping Variables}},
  booktitle = {Conference on Uncertainty in Artificial Intelligence},
  year = {2012},
}
Figure