Lie Group Integrators for Manifold Constrained Dynamics

This direction is split into other directions: manifold constraint violation, manifold-preserving integration. Its last version stays readable and citable here.

Version 1 of 193 papers127 conceptsfrozen 2026-10-04

In classical numerical analysis, we treat the world as a flat, Euclidean plane. When we solve an ordinary differential equation (ODE), we take a small step in the direction of a velocity vector, effectively drawing a sequence of short straight lines. However, many physical and mathematical systems do not live in flat space. A satellite’s orientation lives on a rotation group; a robot arm’s joints live on a manifold of angles; and the state of a quantum system lives on a complex sphere.

If you apply a standard "flat-earth" solver like Runge-Kutta to these systems, you encounter numerical drift. A linear step from a point on a sphere will inevitably land outside the sphere. While one might try to "hack" this by projecting the result back onto the manifold, this often destroys physical invariants like energy or momentum.

Lie Group Integrators solve this by ensuring the solution remains on the manifold by construction, rather than by correction.

The Lift-Solve-Map Cycle

The core intuition behind Lie group integrators, such as the foundational Runge–Kutta–Munthe–Kaas (RKMK) schemes described by Arne Marthinsen, Hans Munthe–Kaas, and Brynjulf Owren in Simulation of ordinary differential equations on manifolds, is a three-step geometric cycle:

  1. Lift to the Lie Algebra: Every Lie group (the curved manifold) has an associated Lie algebra (a flat vector space representing infinitesimal transformations). We "lift" the differential equation from the curved manifold to this flat tangent space.
  2. Solve in the Algebra: Because the Lie algebra is a flat vector space, we can use standard numerical techniques without fear of "falling off" the manifold.
  3. Map back via the Exponential Map: Once we have computed the update in the flat algebra, we use the exponential map—a generalization of rotation—to move the state along the manifold's intrinsic curvature.

As Brynjulf Owren notes in Lie group integrators, this ensures the solution remains on the manifold to machine precision. By evolving the system through the composition of flows rather than linear additions, these methods preserve the structural properties of the space, such as the orthogonality of a rotation matrix, throughout the simulation.

Structure Preservation and Variational Principles

Beyond simply staying on the manifold, we often want to preserve physical "constants of motion," such as energy. Standard solvers tend to "bleed" or "gain" energy over long simulations.

Taeyoung Lee, Melvin Leok, and N. Harris McClamroch argue in Discrete Control Systems for a "discrete-first" approach. Instead of discretizing a continuous-time controller, they derive Variational Integrators by discretizing the underlying physical principle (the Lagrangian) itself.

This approach, further explored in Variational Symplectic Accelerated Optimization on Lie Groups, results in symplectic updates. Because the update rules are derived from the geometry of the manifold, they naturally preserve the system's symplectic structure, leading to superior long-term stability in complex simulations like the $N$-fold pendulum (Ergys Çokaj et al.).

From Physics to Generative AI

The same geometric principles that stabilize a satellite simulation are now being used to build more robust generative models. Standard Continuous Normalizing Flows (CNFs) and Diffusion Models struggle when data lives on curved surfaces (like the torsion angles of a protein).

Recent work has translated these geometric integrators into the language of deep learning:

Why It Works: The Power of Intrinsic Coordinates

The recurring theme across these 73 papers is the rejection of "extrinsic" coordinates. When you represent a rotation as a 3x3 matrix in 9D space, you are fighting against 6 redundant degrees of freedom that want to drift.

By using Lie group integrators, researchers like Elena Celledoni and Brynjulf Owren (Preserving first integrals with symmetric Lie group methods) show that we can treat the manifold as the primary reality. Whether it is using the Cayley transform to maintain unit-length constraints (Dmitry V. Zenkov et al.) or operator splitting to separate momentum and position updates (Trivialized Momentum Facilitates Diffusion Generative Modeling on Lie Groups), these methods succeed because they bake the "rules" of the space into the very first step of the calculation.

Papers in this version

Showing 60 of 93 papers.

History & citationVersion 1 · 2026-10-04

Split into other directions · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_lie_group_integrators_for_manifold_const_f646aa8f,
  title = {Lie Group Integrators for Manifold Constrained Dynamics},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/lie-group-integrators-for-manifold-constrained-dynamics/rdr_f646aa8ff5b242ff80af930950ce7f46},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}

This exact version (version 1, frozen text):

@misc{lacuna_lie_group_integrators_for_manifold_const_f646aa8f_v1,
  title = {Lie Group Integrators for Manifold Constrained Dynamics},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/lie-group-integrators-for-manifold-constrained-dynamics/rdr_f646aa8ff5b242ff80af930950ce7f46/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}