Mining Causality from Continuous-time Dynamics Models: An Application to Tsunami Forecasting

Fan Wu, Sanghyun Hong, Donsub Rim, Noseong Park, Kookjin Lee

Introduction

Continuous-time dynamics models, particularly Neural Ordinary Differential Equations (NODEs), have emerged as powerful tools for modeling complex time-series data. By treating system evolution as a continuous flow, they offer a physically intuitive alternative to discrete-step models. However, these models often function as "black boxes," providing high-accuracy forecasts without revealing the underlying causal mechanisms. In critical domains like tsunami forecasting or climate science, understanding why a prediction was made is as important as the prediction itself. This work introduces a framework to extract Granger causality directly from these continuous-time models.

Methodology: Neural Granger Causality

The researchers propose a mechanism to "mine" causality by enforcing sparsity in the input layers of the neural network. The core concept relies on the definition of Granger causality: a variable $x_j$ is causal for $x_i$ if its past values help predict the future of $x_i$.

To implement this, the framework utilizes:

  1. Component-wise Architectures: Instead of a single monolithic network, separate multi-layer perceptrons (MLPs) represent the derivative of each state variable.
  2. Sparsity-Promoting Loss: A group Lasso-style $L_2$ norm penalty is applied to the columns of the first weight layer ($W^{i,1}$). This forces the model to ignore non-causal inputs by driving their weights to zero.
  3. Neural Delay Differential Equations (NDDEs): To account for physical transport delays (e.g., wave travel time), the model is extended to handle lagged inputs.
Architecture for mining Granger causality in (a) standard NODEs and (b) delayed systems (NDDEs).

Experimental Validation

The approach was validated across three benchmarks:

  • Lorenz-96 System: A standard climate modeling benchmark used to test spatial dependency recovery.
  • Mackey-Glass Equation: A chaotic system with inherent time delays.
  • Tsunami Dataset: Real-world synthetic simulations in the Strait of Juan de Fuca, involving surface elevation readings from multiple gauges.

Results and Discussion

The proposed method successfully recovered known causal structures while maintaining high forecasting accuracy. In the Lorenz-96 system, the model perfectly identified the "neighbor-only" dependencies inherent in the governing equations.

Recovered causal structure for the Lorenz-96 system ($N=8$), where the sparsity pattern correctly identifies local dependencies.

In the tsunami application, the NDDE models outperformed standard NODEs. The "mined" causality aligned with physical wave propagation: Gauge 702 (at the strait's entrance) was found to influence interior gauges (901 and 911) with specific time delays (approx. 24 and 60 minutes). These delays correspond to the physical "sloshing" or seiche effects within the local topography.

Conclusion

By integrating sparsity-promoting penalties into continuous-time neural architectures, this research bridges the gap between predictive performance and interpretability. The ability to automatically detect both causal variables and their associated time lags makes this framework particularly valuable for high-stakes physical systems where understanding the "why" behind a forecast is essential for decision-making.

Summary updated

Abstract

Continuous-time dynamics models, such as neural ordinary differential equations, have enabled the modeling of underlying dynamics in time-series data and accurate forecasting. However, parameterization of dynamics using a neural network makes it difficult for humans to identify causal structures in the data. In consequence, this opaqueness hinders the use of these models in the domains where capturing causal relationships carries the same importance as accurate predictions, e.g., tsunami forecasting. In this paper, we address this challenge by proposing a mechanism for mining causal structures from continuous-time models. We train models to capture the causal structure by enforcing sparsity in the weights of the input layers of the dynamics models. We first verify the effectiveness of our method in the scenario where the exact causal-structures of time-series are known as a priori. We next apply our method to a real-world problem, namely tsunami forecasting, where the exact causal-structures are difficult to characterize. Experimental results show that the proposed method is effective in learning physically-consistent causal relationships while achieving high forecasting accuracy.
BibTeX
@misc{wu2022mining,
  author = {Fan Wu and Sanghyun Hong and Donsub Rim and Noseong Park and Kookjin Lee},
  title = {{Mining Causality from Continuous-time Dynamics Models: An Application to Tsunami Forecasting}},
  year = {2022},
  eprint = {2210.04958},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2210.04958},
}
Figure