Deep neural networks on diffeomorphism groups for optimal shape reparameterization

Elena Celledoni, Helge Glöckner, Jørgen Riseth, Alexander Schmeding

TL;DR

This paper introduces a novel "learning-free" deep learning framework to solve the optimal reparameterization problem in shape analysis. By modeling diffeomorphisms as a composition of residual neural network (ResNet) layers, the authors provide a computationally efficient algorithm that is mathematically guaranteed to produce invertible, orientation-preserving alignments for both curves and surfaces.

What Problem Does This Paper Address?

In shape analysis, comparing two objects (like two different outlines of a heart or two 3D scans of a face) requires calculating the "geodesic distance" between them. However, a single shape can be described by infinitely many mathematical parameterizations. To find the true distance, you must first "align" the objects by finding the optimal reparameterization—a transformation known as a diffeomorphism.

Finding this optimal transformation is notoriously difficult. It involves solving a complex optimization problem on an infinite-dimensional Lie group. Traditional methods, such as Riemannian gradient descent, are often computationally expensive, slow to converge, and prone to getting stuck in local minima. The authors aim to bridge the gap between abstract differential geometry and practical, high-performance computing.

Methods

The authors propose representing a diffeomorphism $\phi$ as a composition of $L$ elementary layers: $$\phi = \phi_L \circ \dots \circ \phi_1$$ Each layer is structured as a Residual Block: $\phi_\ell(x) = x + f_\ell(x)$.

Key Innovations:

  1. Invertibility via Lipschitz Constraints: To ensure the transformation remains a valid diffeomorphism (i.e., it doesn't "fold" the space or become non-invertible), the authors enforce a constraint where each layer $f_\ell$ must be 1-Lipschitz. They implement this using a projection operator that scales the weights of the network during optimization.
  2. Basis Function Representation: Instead of arbitrary dense layers, they use a specific basis of functions (truncated Fourier sine series) that naturally satisfy boundary conditions (e.g., fixing the endpoints of a curve).
  3. Learning-Free Optimization: Unlike standard deep learning that trains on massive datasets to generalize, this method is "learning-free" (similar to a Deep Image Prior). The network is optimized from scratch for every single pair of shapes to find the best possible alignment between them.
  4. Implementation: The algorithm is built using PyTorch and utilizes the BFGS optimizer, a second-order optimization method that is more stable for deterministic problems than standard stochastic gradient descent (SGD).

Datasets

The paper evaluates the method on several synthetic and real-world benchmarks:

  • Synthetic Curves: Parametric curves defined by trigonometric functions (e.g., Figure 6.1).
  • Synthetic Surfaces: 3D graphs and immersions used to test the 2D extension of the algorithm.
  • MNIST Digits: The authors use the framework to perform "shape interpolation" (warping) between different handwritten digits, demonstrating how one shape can smoothly transform into another after proper alignment.

Key Insights and Ideas

  • ResNets as ODE Flows: The authors lean into the interpretation of Residual Networks as discretizations of Ordinary Differential Equations (ODEs). This allows them to treat the depth of the network as "time" in a continuous deformation process.
  • Universal Approximation: A major theoretical contribution is the proof that these specific ResNet architectures possess "universal approximation properties" on diffeomorphism groups. This means that, given enough layers, the network can represent any smooth, orientation-preserving transformation.
  • Depth vs. Width: The results indicate that "deep" networks (more layers) are more efficient at reaching low error rates than "wide" networks (more basis functions per layer). A deep network can achieve high performance using significantly fewer total coefficients.

Key Results

  • Superior Convergence: Compared to traditional Riemannian gradient descent, the deep learning approach converges to a significantly lower error in fewer iterations (see Figure 2.1).
  • Robust Alignment: The method successfully recovers complex diffeomorphisms involving both rotation and stretching that traditional methods struggle to resolve.
  • Smooth Interpolation: In the MNIST experiments, the reparameterization allows for "geodesic" transitions where parts of the shape move logically (e.g., a stroke lengthening) rather than simply fading in and out (cross-dissolving).

Limitations and Future Work

  • Fixed Basis Functions: The current implementation relies on a fixed Fourier basis. The authors suggest that future work could explore more adaptive network structures that might capture local shape features more efficiently.
  • Boundary Constraints: The current model focuses on diffeomorphisms that fix the boundary pointwise. While mathematically convenient, some real-world applications might require "boundary-sliding" transformations.
  • Computational Overhead: While faster than traditional gradient descent, running a full BFGS optimization for every pair of shapes is still computationally intensive for very high-resolution 3D surfaces.
  • Point Cloud Integration: The authors note that while they currently work with parametric forms, incorporating the construction of the parameterization directly from raw point clouds into the network architecture is a promising next step.

Summary updated

Abstract

One of the fundamental problems in shape analysis is to align curves or surfaces before computing geodesic distances between their shapes. Finding the optimal reparametrization realizing this alignment is a computationally demanding task, typically done by solving an optimization problem on the diffeomorphism group. In this paper, we propose an algorithm for constructing approximations of orientation-preserving diffeomorphisms by composition of elementary diffeomorphisms. The algorithm is implemented using PyTorch, and is applicable for both unparametrized curves and surfaces. Moreover, we show universal approximation properties for the constructed architectures, and obtain bounds for the Lipschitz constants of the resulting diffeomorphisms.
BibTeX
@inproceedings{celledoni2023deep,
  author = {Elena Celledoni and Helge Glöckner and Jørgen Riseth and Alexander Schmeding},
  title = {{Deep neural networks on diffeomorphism groups for optimal shape reparameterization}},
  booktitle = {BIT},
  year = {2023},
  doi = {10.1007/s10543-023-00989-5},
}
Figure