A Generalized Lyapunov Feature for Dynamical Systems on Riemannian Manifolds

Rushil Anirudh, Vinay Venkataraman, Pavan Turaga2015 · DOI

TL;DR

This paper introduces the "largest Riemannian Lyapunov exponent" (L-RLE), a novel feature that generalizes the concept of Lyapunov exponents to dynamical systems evolving on Riemannian manifolds. This allows for a more robust analysis of complex, non-linear dynamics in data that naturally resides on these curved spaces, such as human actions represented as shapes.

What Problem Does This Paper Address?

Many real-world phenomena, like human activities, dynamic scenes, and crowd movements, generate data that can be represented as trajectories over time. While traditional methods often treat this data in Euclidean space, many advanced representations naturally lie on non-Euclidean spaces called Riemannian manifolds (e.g., shapes, rotations). Existing methods for analyzing the dynamics of these systems, particularly those that capture chaotic behavior, are largely limited to Euclidean data. This leaves a gap in understanding and quantifying the higher-order dynamical properties of systems evolving on these curved manifolds, which is crucial for tasks like fine-grained activity classification.

Methods

The core contribution is the largest Riemannian Lyapunov exponent (L-RLE). This is a generalization of the well-established largest Euclidean Lyapunov exponent (L-ELE), which quantifies the rate of divergence of nearby trajectories, indicating chaotic behavior.

The authors propose treating the Riemannian manifold itself as the "phase space" for the dynamical system. This is a key departure from traditional methods that require reconstructing a phase space from time-series data, a process that doesn't generalize well to manifolds.

They demonstrate the L-RLE on two specific manifolds:

  • Grassmann manifold: Used to represent human action silhouettes as affine-invariant subspaces.
  • SO(3) Lie group: Used to represent 3D rotations, common in data from sensors like smartphones.

The computation of L-RLE involves:

  1. Defining the manifold as the phase space.
  2. Measuring the geodesic distance between nearby points (states) on the manifold.
  3. Estimating the rate of divergence of these nearby points over time, analogous to the L-ELE calculation.

Datasets

  • UMD Actions dataset: Used for evaluating the L-RLE on human actions. This dataset contains 10 actions, each performed 10 times, resulting in 100 action sequences. The authors note that the relatively static background in this dataset facilitates the extraction of shape silhouettes.

Key Insights and Ideas

  • Manifold as Phase Space: The most significant insight is treating the Riemannian manifold itself as the phase space. This bypasses the complex phase space reconstruction needed for Euclidean data and directly leverages the geometric structure of the data.
  • Generalization of Chaos Measure: The L-RLE successfully extends a fundamental concept from chaos theory (Lyapunov exponents) to the more complex domain of Riemannian manifolds, opening up new avenues for dynamical analysis.
  • Viewpoint Invariance: Representations on the Grassmann manifold, used for shape analysis, naturally provide affine invariance. This means the L-RLE is more robust to changes in viewpoint or minor affine distortions compared to Euclidean methods.
  • Consistency with Euclidean Measures: The L-RLE shows a strong correlation with L-ELE when applied to Euclidean features, suggesting it's a valid generalization. It also accurately reflects the chaotic nature of known attractors.

Key Results

  • The L-RLE correlates well with the largest Euclidean Lyapunov exponent (L-ELE) when applied to Euclidean features derived from the same data.
  • When data is artificially sheared to simulate minor viewpoint changes, the L-RLE remains robust, while Euclidean methods (like multivariate embedding) show significant distortion in their phase space representations.
  • When applied to standard chaotic attractors (Lorenz, Rossler) embedded on SO(3), the L-RLE correctly identifies higher chaos with higher values and periodic signals with values close to zero, mirroring the behavior of L-ELE. For example, the Lorenz attractor (higher chaos) yielded an L-RLE of 21.02, while a periodic signal yielded 0.008.

Limitations and Future Work

  • Assumption of Unchanged Dynamics: The authors acknowledge an assumption that the underlying dynamical latent properties of temporal events remain unchanged when observed in different feature spaces (e.g., Euclidean vs. Riemannian). This is a necessary simplification for validation but might not always hold true.
  • Theoretical Analysis: While the work is empirically validated, the authors suggest that a theoretical analysis of Riemannian dynamical invariants and their estimation algorithms would be a fruitful area for future work.
  • Multimodal Analysis: Investigating how dynamical properties are preserved when the same event is observed in different modalities (e.g., video vs. audio) is proposed as a future direction.

Summary updated

Abstract

Dynamic phenomena such as human activities, dynamic scenes, and moving crowds are commonly observed through visual sensors, resulting in feature trajectories sampled in time. Such phenomena can be accurately modeled by taking the temporal variations and changes into account. For problems where the trajectories are sufficiently different, elastic metrics can provide distances that are invariant to speed, but for more complex problems such as fine grained activity classification, one needs to exploit higher order dynamical properties. For features in the Euclidean space, applications such as crowd monitoring, dynamic scene recognition and human movement quality analysis have found a lot of success this way. In this paper we propose the largest Riemannian Lyapunov exponent (L-RLE), which is the first generalization of the largest Lyapunov exponent to Riemannian manifolds. The largest Lyapunov exponent is a classic measure to quantify the amount of chaos within signals in the Euclidean space, and allows us to exploit higher order dynamics for various applications. We show the effectiveness of the L-RLE on two manifolds the Grassmann and the SO(3) lie group. By modeling human actions as dynamic processes evolving on Riemannian manifolds, we show that L-RLE can measure the amount of chaos within each action accurately. We show that our measure is a good generalization of largest Euclidean Lyapunov exponent (L-ELE), and is less susceptible to arbitrary distortions.
BibTeX
@misc{anirudh2015generalized,
  author = {Rushil Anirudh and Vinay Venkataraman and Pavan Turaga},
  title = {{A Generalized Lyapunov Feature for Dynamical Systems on Riemannian Manifolds}},
  year = {2015},
  doi = {10.5244/c.29.diffcv.4},
}
Figure