Log-Variance Divergence for Diffusion Path Sampling

This direction is merged into another direction: local mode entrapment. Its last version stays readable and citable here.

Version 1 of 112 papers21 conceptsfrozen 2026-10-04

Sampling from unnormalized probability densities—where we know the energy function but not the normalizing constant—is a fundamental challenge in Bayesian inference and statistical mechanics. While diffusion models have revolutionized generative modeling, they typically rely on large datasets. When we instead try to "solve" a distribution defined by an energy function, standard variational objectives like the Kullback-Leibler (KL) divergence often fail, leading to mode collapse where the sampler ignores significant portions of the distribution.

Recent work by Julius Berner, Lorenz Richter, and others has established a more robust framework for this problem by treating sampling as a stochastic optimal control problem and introducing the log-variance divergence as a superior optimization objective.

The Control Perspective on Diffusion

The core insight, detailed in An optimal control perspective on diffusion-based generative modeling, is that the process of transforming a simple base distribution (like a Gaussian) into a complex target can be viewed through the lens of the Hamilton–Jacobi–Bellman (HJB) equation. In this view, the "score" or "drift" of the diffusion process is an optimal control that minimizes the energy required to reach the target distribution.

In standard variational inference, we minimize the KL divergence between the path measure of our controlled diffusion and the target path measure. However, the KL objective is "mode-seeking"; if the target has multiple peaks separated by low-density valleys, the model often collapses into a single peak to minimize the penalty, losing the global structure of the distribution.

Why Log-Variance Divergence Works

To solve this, Richter and Nüsken proposed the log-variance loss in Solving high-dimensional Hamilton-Jacobi-Bellman PDEs using neural networks. Instead of minimizing the average log-ratio of densities (the KL approach), this objective minimizes the variance of the log-ratio between the path measures.

Intuition for the log-variance loss:

  1. Zero Variance at Optimum: When the model perfectly matches the target, the ratio of the path measures becomes a constant (the normalizing constant). At this point, the variance of the log-ratio is exactly zero.
  2. Global Coverage: Because the loss penalizes any deviation from a constant ratio across the entire path space, it forces the model to account for all regions of the target distribution simultaneously. This prevents the sampler from "ignoring" modes, as doing so would create high variance in the log-ratio.
  3. Gradient Stability: As shown in Improved sampling via learned diffusions, this objective eliminates the need to differentiate through the SDE solver, leading to more stable training and vanishing gradient variance as the model converges.

Applications in Rare Events and Multi-modality

This framework is particularly powerful for scientific domains where the "ground truth" is an energy landscape rather than a dataset.

By shifting the objective from "matching the average" to "minimizing the variance," these researchers have turned diffusion models into a robust tool for exploring complex, high-dimensional energy landscapes.

Papers in this version

History & citationVersion 1 · 2026-10-04

Merged into another direction · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_log_variance_divergence_for_diffusion_pa_7c810eb3,
  title = {Log-Variance Divergence for Diffusion Path Sampling},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/log-variance-divergence-for-diffusion-path-sampling/rdr_7c810eb3ec044ed8a8da5787c3c8d2c2},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-22},
}

This exact version (version 1, frozen text):

@misc{lacuna_log_variance_divergence_for_diffusion_pa_7c810eb3_v1,
  title = {Log-Variance Divergence for Diffusion Path Sampling},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/log-variance-divergence-for-diffusion-path-sampling/rdr_7c810eb3ec044ed8a8da5787c3c8d2c2/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-22},
}