Horizontal Flows and Manifold Stochastics in Geometric Deep Learning

Stefan Sommer, Alex M. Bronstein

TL;DR

This paper bridges stochastic analysis on manifolds with geometric deep learning to solve two major challenges: the path-dependency of filter orientations (holonomy) and the high computational cost of manifold-valued outputs. By using horizontal frame bundle flows and stochastic bridge sampling, the authors provide a theoretically grounded framework for building more robust and efficient neural networks on curved surfaces.

What Problem Does This Paper Address?

Geometric Deep Learning (GDL) extends neural networks to non-Euclidean domains like manifolds (e.g., spheres, 3D shapes). However, two "geometry-induced" headaches persist:

  1. The Orientation Problem (Holonomy): In flat space, "up" is always "up." On a curved manifold, if you move a filter from point A to point B along two different paths, the filter will end up with different rotations. This is called holonomy. Standard methods often use "parallel transport" along the shortest path (geodesic), but this becomes discontinuous when multiple shortest paths exist (the "cut locus").
  2. The Output Problem (Manifold-Valued Data): If a network layer needs to output a point on a manifold (like a 3D rotation or a point on a brain surface), you can't just take a weighted average. You usually need to compute a Fréchet mean, which requires expensive, iterative optimization at every single layer—a massive bottleneck for deep learning.

Methods

The authors propose two novel constructions rooted in stochastic analysis:

  • Horizontal Frame Bundle Flows: Instead of choosing a single orientation for a filter, the authors "lift" the problem to the frame bundle ($OM$)—the space of all possible orientations at every point. They use the Eells-Elworthy-Malliavin construction of Brownian motion to define a convolution that naturally distributes orientations across the manifold. This "stochastic transport" accounts for curvature and avoids the discontinuities of standard parallel transport.
  • Weighted Diffusion Mean (wDM) via Bridge Sampling: To avoid the slow optimization of Fréchet means, the authors introduce the Weighted Diffusion Mean. They use stochastic bridge sampling—a technique to simulate random paths that are "conditioned" to hit a specific target. This allows the network to sample from a distribution centered at the mean, bypassing the need to solve complex optimization problems or find geodesics explicitly.

Datasets

Not discussed in the paper. This work is primarily theoretical and foundational. The authors explicitly state that "actual experimental validation of the methodology [is left] to future work."

Key Insights and Ideas

  • Curvature as a Source of Non-Commutativity: The authors prove (Theorem 1) that the reason manifold convolutions don't "behave" like Euclidean ones (lacking associativity and commutativity) is directly linked to the Riemannian curvature tensor.
  • Stochasticity as a Feature: Instead of trying to find a single "perfect" orientation or mean, the authors embrace stochasticity. By using distributions of orientations and sampling-based means, they create operators that are smoother and more globally aware than their deterministic counterparts.
  • Global Parallel Transport: By using Brownian motion on the frame bundle, they create a notion of "global" parallel transport that circumvents the topological complexities (like the "hairy ball theorem") that plague local methods.

Key Results

  • Equivariance Proofs: The authors demonstrate that their horizontal convolution is equivariant to the choice of local coordinates (gauge equivariance), ensuring the network's output doesn't change just because you labeled your axes differently.
  • Smoothness: Unlike standard parallel transport, which "jumps" at the cut locus, the proposed stochastic flow results in a smooth integrand (for analytic manifolds), making it much better suited for gradient-based learning.
  • Algorithmic Sketch: The paper provides a concrete "Algorithm 1" for evaluating these complex stochastic convolutions and "Algorithm 2" for estimating the Weighted Diffusion Mean using Importance Sampling.

Limitations and Future Work

The primary limitation is the lack of empirical results. While the mathematical foundation is rigorous, the practical performance—both in terms of accuracy and computational overhead—remains to be seen.

Future work suggested by the authors includes:

  • Implementing these algorithms in frameworks like PyTorch or TensorFlow.
  • Testing the "stochastic" nature of the wDM against other stochastic neural network models like Dropout or Bayesian Neural Networks.
  • Applying these methods to discrete geometries (graphs/meshes) using discrete connections.

Summary updated

Abstract

We introduce two constructions in geometric deep learning for 1) transporting orientation-dependent convolutional filters over a manifold in a continuous way and thereby defining a convolution operator that naturally incorporates the rotational effect of holonomy; and 2) allowing efficient evaluation of manifold convolution layers by sampling manifold valued random variables that center around a weighted diffusion mean. Both methods are inspired by stochastics on manifolds and geometric statistics, and provide examples of how stochastic methods – here horizontal frame bundle flows and non-linear bridge sampling schemes, can be used in geometric deep learning. We outline the theoretical foundation of the two methods, discuss their relation to Euclidean deep networks and existing methodology in geometric deep learning, and establish important properties of the proposed constructions.
BibTeX
@article{sommer2022horizontal,
  author = {Stefan Sommer and Alex M. Bronstein},
  title = {{Horizontal Flows and Manifold Stochastics in Geometric Deep Learning}},
  journal = {IEEE Trans. Pattern Anal. Mach. Intell.},
  year = {2022},
  url = {https://openreview.net/forum?id=NSz-nkgKc0L},
}

Loading related content...

Figure