Phase Space Reconstruction from Time Series Data

297 concepts219 papers4 proposals

In fields ranging from fluid dynamics to neuroscience, we rarely enjoy full visibility into the systems we study. Instead, we are forced to operate under partial observability: a doctor monitors a patient's brain via a single EEG channel; a meteorologist tracks wind speed at a single weather station; an engineer measures fluid velocity at a handful of fixed points.

How can we hope to model, predict, or control a complex, high-dimensional system when we can only see a tiny fraction of its moving parts?

The answer lies in a profound insight from dynamical systems theory: in a coupled system, the history of a single observed variable acts as a "shadow" of the entire system's state space. By unfolding this history into a higher-dimensional space—a process known as phase space reconstruction or delay embedding—we can recover the true, hidden geometry of the underlying system.


The Intuition: Unfolding the Shadow

Imagine a three-dimensional chaotic attractor, like the famous Lorenz butterfly. If you project this attractor down onto a single axis, you get a one-dimensional time series that looks like erratic, self-overlapping noise. Because the trajectory constantly intersects itself in one dimension, a single point in time does not give you enough information to know where the system is heading next.

To resolve this ambiguity, we need to unfold the trajectory. We do this by creating a new multi-dimensional vector from lagged copies of our single observation:

$$\mathbf{x}(t) = [s(t), s(t-\tau), s(t-2\tau), \dots, s(t-(d-1)\tau)]$$

where $\tau$ is the time delay and $d$ is the embedding dimension.

Why does this work? Because the variables in a dynamical system are coupled, the current state of an unobserved variable leaves an indelible mark on the history of the observed variable. By looking backward in time, we are effectively reading the encoded state of the rest of the system.

Takens' Embedding Theorem guarantees that if we choose a sufficiently large embedding dimension $d$, the reconstructed "shadow manifold" will preserve the essential topological properties of the original, unobserved phase space. Trajectories will stop intersecting themselves, revealing the true, deterministic structure of the system.

For instance, Yue Li demonstrates this unfolding process in A Comparison Analysis of Embedding Dimensions between Normal and Epileptic EEG Time Series, using phase space reconstruction to determine the minimum number of variables required to capture the deterministic structure of neural dynamics during epileptic seizures. Similarly, Vinay Venkataraman et al. leverage this geometric preservation in Shape Distributions of Nonlinear Dynamical Systems for Video-Based Inference., treating complex human actions in video as multi-dimensional trajectories whose underlying attractors can be classified using shape-theoretic frameworks.


Deep Learning as Implicit Reconstruction

While classical phase space reconstruction relies on manually tuning the time delay $\tau$ and embedding dimension $d$, modern deep learning architectures have revealed a fascinating parallel: neural networks often perform state space reconstruction implicitly.

When an LSTM or a Transformer processes a sequence of past observations, it is essentially constructing a latent delay embedding. Yin Li explores this connection deeply in LETS Forecast: Learning Embedology for Time Series Forecasting, demonstrating a conceptual equivalence between classical time-delay embedding and the local window patching used in state-of-the-art transformer models. This suggests that the remarkable success of sequence models on time series data is rooted in their ability to learn the underlying geometry of the system's attractor.

Researchers are now explicitly baking these physics-based principles into deep learning architectures to handle extreme data scarcity:


Mapping Causality Across Shadow Manifolds

Beyond prediction and control, phase space reconstruction provides a powerful lens for causal discovery. In complex, nonlinear systems, traditional statistical tools like Granger Causality often fail because variables are tightly coupled; everything appears correlated with everything else, creating "mirage" correlations.

Reconstruction resolves this through the principle of Convergent Cross Mapping (CCM). If a variable $X$ causally drives a variable $Y$, then the historical states of $X$ must be continuously encoded within the dynamics of $Y$. Consequently, the shadow manifold reconstructed from $Y$ should perfectly map to the shadow manifold reconstructed from $X$. If we can use the local neighborhood of points on $Y$'s manifold to accurately estimate the states on $X$'s manifold, we have definitive, model-free proof of a causal link.

[ True State Space ] 
       /        \
      /          \  (Projections)
     v            v
[ Manifold X ] <--- [ Manifold Y ]
  (Can Y cross-map to estimate X? If yes, X causes Y.)

This geometric approach to causality has been supercharged by deep learning to handle noisy, real-world data. Matthew James Vowels et al. introduce Neural Shadow-Mapping in Shadow-Mapping for Unsupervised Neural Causal Discovery, combining deep learning with shadow manifolds to discover causal relationships directly from raw, unlabelled video data.

To address the challenges of irregularly sampled or sporadic data, Edward De Brouwer et al. propose Latent Convergent Cross Mapping, which uses Neural ODEs to learn continuous-time latent representations of attractors, allowing for causal inference where traditional delay-embedding techniques break down. Furthermore, Kurt Butler et al. extend this paradigm to vector fields in Tangent Space Causal Inference: Leveraging Vector Fields for Causal Discovery in Dynamical Systems, utilizing the geometric properties of tangent spaces on reconstructed manifolds to map out directional influences with unprecedented robustness.

Summary

Phase space reconstruction shifts our perspective from analyzing raw, one-dimensional signals to analyzing the multi-dimensional geometry that generated them. Whether implemented through classical mathematical embeddings or learned implicitly via deep neural networks, unfolding a time series into its true latent state space allows us to see past the chaos of partial observations and uncover the deterministic rules governing the system.

History & citationVersion 2 · 2026-10-04

Current · Permanent link

  1. Version 2 (latest) · 2026-10-04 · 223 papers
  2. Version 1 · 2026-10-04 · 293 papers
Cite this direction

Latest version (a living page):

@misc{lacuna_phase_space_reconstruction_2dd2c69a,
  title = {phase space reconstruction},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/phase-space-reconstruction/rdr_2dd2c69a29fa432ebc0ba143a7da258d},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}

This exact version (version 2, frozen text):

@misc{lacuna_phase_space_reconstruction_2dd2c69a_v2,
  title = {phase space reconstruction},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/phase-space-reconstruction/rdr_2dd2c69a29fa432ebc0ba143a7da258d/v/2},
  note = {Version 2, frozen 2026-10-04. Accessed 2026-11-21},
}
About

These directions overlap with this one through shared papers.

See something wrong? Report a mistake