Semiparametric Causal Discovery and Inference with Invalid Instruments

Jing Zou, Wei Li, Wei LinarXiv 2025 · DOI · arXiv

TL;DR

Causal discovery from observational data is often stymied by hidden confounders and complex, nonlinear relationships. This paper introduces PLACID, a robust framework that uses "invalid" instrumental variables and partially linear models to accurately reconstruct causal graphs (DAGs) and estimate effects without requiring strict linearity or perfectly valid instruments.

What Problem Does This Paper Address?

Identifying "what causes what" is the holy grail of data science, but observational data is messy. Two major hurdles usually stand in the way:

  1. Unobserved Confounders: Hidden variables that influence both a cause and an effect, creating "spurious" correlations that look like causation.
  2. Model Misspecification: Most causal discovery tools assume linear relationships. If the real world is nonlinear, these tools often fail to find the correct causal direction.

Instrumental Variables (IVs) are the classic solution for hidden confounders. An IV is a variable that affects the "cause" but has no direct effect on the "outcome." However, finding "valid" IVs is incredibly hard. Most existing methods break if even a few IVs are "invalid" (i.e., they have a direct effect on the outcome) or if the relationship between the IV and the variables is nonlinear.

This paper tackles the challenge of learning a Directed Acyclic Graph (DAG) when you have a pool of candidate IVs that might be invalid and whose relationships with your primary variables are unknown and potentially nonlinear.

Methods

The authors propose a method called PLACID (Partially Linear Approach to Causal Instrument-based Discovery). It operates under a Partially Linear Structural Equation Model, where the relationships between primary variables are linear, but the influence of the instruments (IVs) is nonparametric (nonlinear).

The core algorithm consists of two main stages:

  1. Structure Learning (The Peeling Algorithm): Instead of trying to orient every edge at once, PLACID uses a "peeling" strategy. It identifies "leaf nodes" (variables that don't cause anything else in the current set) by testing for independence using Distance Correlation (DC). Unlike standard correlation, DC can detect nonlinear dependencies. By iteratively "peeling" away these leaf nodes, the algorithm reconstructs the Ancestral Relation Graph (ARG).

  2. Causal Inference (GMM & Surrogate IVs): Once the potential structure is known, the authors use a Generalized Method of Moments (GMM) approach to estimate the actual causal coefficients. The "secret sauce" here is the construction of surrogate valid IVs. By projecting the candidate IVs into a specific functional subspace, they can satisfy the necessary "moment conditions" for identification even if some of the original instruments were invalid.

Finally, they apply the Benjamini–Yekutieli procedure to control the False Discovery Rate (FDR), ensuring that the edges they "discover" are statistically reliable.

Datasets

The authors evaluated PLACID using both synthetic and real-world data:

  • Simulated Data: They generated "Random" and "Hub" DAGs with unobserved confounders, varying the number of variables ($p=10, 20$) and types of instruments (continuous vs. discrete).
  • ADNI Dataset: They applied the method to the Alzheimer’s Disease Neuroimaging Initiative dataset to infer gene regulatory networks. This involved 21 genes (primary variables) and 42 Single Nucleotide Polymorphisms (SNPs) acting as candidate IVs, with data from 709 individuals.

Key Insights and Ideas

  • Nonlinearity is a Feature, Not a Bug: The paper shows that failing to account for nonlinear relationships between IVs and variables doesn't just reduce precision—it can lead to completely wrong causal directions.
  • The Power of Redundancy: You don't need to know which IVs are valid. As long as a certain number of them meet the "plurality" or "majority" rule (depending on the specific assumptions), the surrogate IV approach can filter out the "noise" from the invalid ones.
  • Leaf-First Discovery: The peeling approach is computationally elegant. By focusing on identifying what isn't a cause (the leaves) first, the algorithm avoids the combinatorial explosion often associated with searching for DAGs.

Key Results

  • Superior Accuracy: In simulations with nonlinear dependencies, PLACID significantly outperformed existing methods like GrIVET, RFCI, and LRpS-GES. For example, in hub graphs with continuous variables, PLACID achieved a True Positive Rate (TPR) of 1.00 and a Structural Hamming Distance (SHD) of 0.00, while competitors struggled with high false discovery rates.
  • Robust FDR Control: The method consistently kept the False Discovery Proportion (FDP) below the target level (e.g., 0.05), which is critical for scientific applications where false positives are costly.
  • Biological Discovery: In the Alzheimer’s (ADNI) study, PLACID identified a dense network of interactions around the LRP1 gene, a known regulator of amyloid-β and tau. It uncovered more edges than previous linear-based methods, suggesting that many gene-SNP interactions are inherently nonlinear.

Limitations and Future Work

  • Instrument Independence: The current theory assumes that candidate IVs are independent of each other. While common in genetics (due to linkage disequilibrium clumping), this might not hold in other fields like economics.
  • Linearity Between Primaries: While the IV-to-variable relationship is nonlinear, the relationships between the primary variables ($Y \to Y$) are still assumed to be linear. Extending this to fully nonlinear SEMs is a suggested next step.
  • High-Dimensional Scaling: While the method works well for $p=20$, the authors note that investigating the consistency of the Ancestral Relation Graph in truly high-dimensional settings (where $p \gg n$) remains an open research question.

Summary updated

Abstract

Learning causal relationships among a set of variables, as encoded by a directed acyclic graph, from observational data is complicated by the presence of unobserved confounders. Instrumental variables (IVs) are a popular remedy for this issue, but most existing methods either assume the validity of all IVs or postulate a specific form of relationship, such as a linear model, between the primary variables and the IVs. To overcome these limitations, we introduce a partially linear structural equation model for causal discovery and inference that accommodates potentially invalid IVs and allows for general dependence of the primary variables on the IVs. We establish identification under this semiparametric model by constructing surrogate valid IVs, and develop a finite-sample procedure for estimating the causal structures and effects. Theoretically, we show that our procedure consistently learns the causal structures, yields asymptotically normal estimates, and effectively controls the false discovery rate in edge recovery. Simulation studies demonstrate the superiority of our method over existing competitors, and an application to inferring gene regulatory networks in Alzheimer's disease illustrates its usefulness.
BibTeX
@misc{zou2025semiparametric,
  author = {Jing Zou and Wei Li and Wei Lin},
  title = {{Semiparametric Causal Discovery and Inference with Invalid Instruments}},
  year = {2025},
  eprint = {2504.12085},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2504.12085},
  howpublished = {arXiv},
}
Figure