Mirror Maps for Constrained Sampling and Generative Modeling

This direction is no longer present in the current build. Its last version stays readable and citable here.

Version 1 of 122 papers33 conceptsfrozen 2026-10-04

In many real-world domains, data does not live in a flat, infinite Euclidean space. Instead, it is bound by hard constraints: probabilities must sum to one, physical systems must have positive energy, and quantum density matrices must be positive semi-definite.

Standard machine learning tools—like Langevin dynamics for sampling or diffusion models for generation—struggle with these boundaries. When a particle or a sample hits a constraint, the typical solution is to "project" it back into the valid region. However, as noted by Anming Gu and Juno Kim in Mirror Mean-Field Langevin Dynamics, projections create artificial mass accumulation at the boundaries and introduce mathematical instabilities that degrade the statistical integrity of the model.

The research direction emerging across these papers is the use of Mirror Maps to bypass projections entirely. By warping the geometry of the space, researchers are transforming constrained problems into unconstrained ones, allowing standard algorithms to work perfectly "under the hood."

The Intuition: Pushing Boundaries to Infinity

The core mechanism is a mathematical object called a mirror map—the gradient of a strictly convex barrier function.

Think of a constrained space (the "primal space") as a room with walls. A mirror map acts like a lens that stretches the room. As you move toward a wall, the map stretches the space more and more, such that the wall is effectively pushed to infinity. This transformed space is called the dual space.

In the dual space, there are no boundaries. A sampling particle or a generative flow can move freely according to standard Euclidean rules. When we want to see where the particle is in the real world, we use the inverse mapping to pull it back to the primal space. Because the boundaries were at infinity in the dual space, the particle can never actually cross them in the primal space.

Sampling without Bias

For years, a central challenge in Bayesian inference was sampling from distributions restricted to convex sets. The Mirror-Langevin Algorithm (MLA) was proposed to solve this, but it was long believed to have a "non-vanishing bias"—an inherent error that wouldn't go away even with tiny steps.

Kwangjun Ahn and Sinho Chewi demonstrated in Efficient constrained sampling via the mirror-Langevin algorithm that MLA could outperform projection-based methods in high dimensions. This was further solidified by Molei Tao and colleagues in The Mirror Langevin Algorithm Converges with Vanishing Bias, who proved that the bias does indeed vanish as the step size decreases. By analyzing the dynamics in the dual space, they showed that MLA is a mathematically rigorous way to sample from constrained domains with arbitrary accuracy.

Generative Modeling on Manifolds

This "dual space" philosophy has recently revolutionized generative modeling. Standard diffusion models assume data is Gaussian, which is impossible for data constrained to a simplex or a sphere.

Guan-Horng Liu and Evangelos A. Theodorou introduced Mirror Diffusion Models (MDM) in Mirror Diffusion Models for Constrained and Watermarked Generation. Instead of adding noise to the constrained data directly, MDM maps the data to the unconstrained dual space, performs standard Gaussian diffusion there, and then maps it back. This ensures that every image or data point generated is 100% guaranteed to satisfy the constraints.

This approach has been extended to highly specialized fields:

Stability and Hyperparameters

One of the practical triumphs of mirror-based methods is their robustness. In Learning Rate Free Sampling in Constrained Domains, Lester Mackey and Louis Sharrock showed that integrating mirror maps into gradient flow frameworks allows for "coin betting" algorithms that don't require manual learning rate tuning.

Similarly, Yunrui Guan and Krishna Balasubramanian addressed the "exploding velocity" problem in Mirror Flow Matching. By combining regularized mirror maps with heavy-tailed priors, they stabilized the training of generative models on convex polytopes, ensuring that the numerical solvers don't "break" as they approach the boundaries of the domain.

Summary

The shift from projection to mirroring represents a fundamental change in how we handle constraints. Instead of treating boundaries as obstacles to be bounced off of, mirror-based methods treat them as geometric features to be incorporated into the coordinate system itself. Whether in optimizing fuel cell systems or sampling with Stein operators, the mirror map provides a unified language for ensuring that machine learning models respect the hard physical and mathematical laws of the data they represent.

Papers in this version

History & citationVersion 1 · 2026-10-04

No longer present in the current build · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_mirror_maps_for_constrained_sampling_and_df0a3f97,
  title = {Mirror Maps for Constrained Sampling and Generative Modeling},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/mirror-maps-for-constrained-sampling-and-generative-modeling/rdr_df0a3f976472483e9e0540b71b525c73},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}

This exact version (version 1, frozen text):

@misc{lacuna_mirror_maps_for_constrained_sampling_and_df0a3f97_v1,
  title = {Mirror Maps for Constrained Sampling and Generative Modeling},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/mirror-maps-for-constrained-sampling-and-generative-modeling/rdr_df0a3f976472483e9e0540b71b525c73/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}