From Random Differential Equations to Structural Causal Models: the stochastic case

Stephan Bongers, Joris M. MooijarXiv 2018 · OpenReview

TL;DR

This paper introduces Structural Dynamical Causal Models (SDCMs), a novel framework that bridges the gap between traditional causal models (SCMs) and continuous-time dynamical systems. SDCMs allow for the formal causal interpretation of complex systems described by random differential equations, enabling a deeper understanding of how interventions affect system dynamics over time.

What Problem Does This Paper Address?

Dynamical systems, often modeled by differential equations, are fundamental to many scientific and engineering disciplines. While these models describe how systems evolve, they often lack a formal causal interpretation. Structural Causal Models (SCMs) provide a powerful framework for causal inference but are typically limited to static, time-independent relationships. This leaves a gap in causally understanding dynamic systems, especially when dealing with stochasticity and continuous time. The authors aim to bridge this gap by extending SCMs to handle time-dependent stochastic processes described by random differential equations.

Methods

The core contribution is the introduction of Structural Dynamical Causal Models (SDCMs). SDCMs represent a dynamical system as a collection of stochastic processes, where each process corresponds to a component of the system. The dynamics are governed by a structured system of random differential equations of arbitrary order. This framework explicitly allows for time-dependence, replacing static random variables in SCMs with dynamic stochastic processes and their derivatives.

Key aspects of their approach include:

  • Formal Definition of SDCMs: Defining the mathematical structure of SDCMs, including their solutions, stochastic interventions, and graphical representations.
  • Existence and Uniqueness of Solutions: Investigating the conditions under which SDCMs have well-defined solutions, considering initial conditions and potential interventions.
  • Markov Properties: Deriving Markov properties for SDCMs, analogous to those for SCMs, to infer conditional independencies from the model structure.
  • Equilibration to SCMs: Defining an "equilibration" operation that transforms a steady SDCM into an SCM. This process captures the system's behavior as time tends to infinity, allowing the application of SCM analysis to the equilibrium states of dynamical systems.
  • Commutation of Equilibration and Intervention: Demonstrating that the equilibration process commutes with stochastic interventions, meaning the causal semantics are preserved.

Datasets

Not discussed in the paper. The paper focuses on theoretical framework development and illustrates concepts with examples from physics and economics.

Key Insights and Ideas

  • Causal Interpretation of Dynamics: SDCMs provide a formal way to assign causal semantics to differential equations, moving beyond mere descriptive modeling. This is crucial for understanding how components influence each other over time.
  • Arbitrary Order Differential Equations: The framework accommodates random differential equations of any order, making it applicable to a wider range of physical and biological systems (e.g., coupled oscillators) than previous approaches limited to first-order systems.
  • Equilibration as a Bridge: The concept of "equilibration" is a powerful tool. It allows us to analyze the long-term causal behavior of dynamic systems using the well-established machinery of SCMs, even when the dynamics themselves are complex.
  • Intervention and Equilibration Commute: This is a significant theoretical result. It means we can reason about the causal effects of interventions on the equilibrium states of a system without needing to solve the full, complex dynamics.
  • Nonancestral Effects Explained: The paper offers an explanation for seemingly counterintuitive "nonancestral" causal effects observed in some cyclic systems. These effects can arise from selection bias introduced by conditioning on the system reaching equilibrium, rather than representing true causal relationships at the dynamic level.

Key Results

  • Formal definition of Structural Dynamical Causal Models (SDCMs) and their solutions.
  • Derivation of Markov properties for SDCMs, enabling conditional independence analysis.
  • A method for equilibrating steady SDCMs to SCMs, preserving causal semantics.
  • Demonstration that equilibration commutes with stochastic perfect interventions.
  • Theoretical conditions for the existence and uniqueness of solutions for SDCMs.
  • Examples illustrating the framework's application to systems like coupled harmonic oscillators and price-supply-demand models.

Limitations and Future Work

  • Smoothness Assumptions: The theoretical results often rely on smoothness assumptions for processes and mechanisms, which might not always hold in practice.
  • Computational Complexity: While the framework is powerful, inferring SDCMs from data might be challenging due to the difficulty of obtaining high-resolution time-series data.
  • Future Work: The authors suggest several avenues for future research:
  • Investigating the notion of local independence in SDCMs.
  • Developing causal interpretation methods for SDCM graphs, especially with cycles and zeroth-order equations.
  • Creating structure and parameter learning algorithms for SDCMs.
  • Extending the framework to discrete-time systems and stochastic differential equations.
  • Exploring the realization of SCMs as stable SDCMs, particularly for nonlinear systems.

Summary updated

Abstract

Dynamical systems are widely used in science and engineering to model systems consisting of several interacting components. Often, they can be given a causal interpretation in the sense that they not only model the evolution of the states of the system's components over time, but also describe how their evolution is affected by external interventions on the system that perturb the dynamics. We introduce the formal framework of structural dynamical causal models (SDCMs) that explicates the causal semantics of the system's components as part of the model. SDCMs represent a dynamical system as a collection of stochastic processes and specify the basic causal mechanisms that govern the dynamics of each component as a structured system of random differential equations of arbitrary order. SDCMs extend the versatile causal modeling framework of structural causal models (SCMs), also known as structural equation models (SEMs), by explicitly allowing for time-dependence. An SDCM can be thought of as the stochastic-process version of an SCM, where the static random variables of the SCM are replaced by dynamic stochastic processes and their derivatives. We provide the foundations for a theory of SDCMs, by (i) formally defining SDCMs, their solutions, stochastic interventions, and a graphical representation; (ii) studying existence and uniqueness of the solutions for given initial conditions; (iii) providing Markov properties for SDCMs with initial conditions; (iv) discussing under which conditions SDCMs equilibrate to SCMs as time tends to infinity; (v) relating the properties of the SDCM to those of the equilibrium SCM. This correspondence enables one to leverage the wealth of statistical tools and discovery methods available for SCMs when studying the causal semantics of a large class of stochastic dynamical systems. The theory is illustrated with examples from different scientific domains.
BibTeX
@misc{bongers2018from,
  author = {Stephan Bongers and Joris M. Mooij},
  title = {{From Random Differential Equations to Structural Causal Models: the stochastic case}},
  year = {2018},
  eprint = {1803.08784},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1803.08784},
}
Figure