A Multiscale Perspective on Maximum Marginal Likelihood Estimation

Ömer Deniz Akyıldız, Iain Souttar, Michela OttobrearXiv 2024 · DOI · arXiv

This paper provides a fresh theoretical lens on a classic problem in statistics: how to find the best parameters for models with "hidden" or latent variables. By reframing Maximum Marginal Likelihood Estimation (MMLE) as a multiscale dynamical system, the authors bridge the gap between applied probability and practical machine learning, proving that "sampling while optimizing" isn't just a heuristic—it’s mathematically sound.

TL;DR

The authors introduce a "Slow-Fast Langevin Algorithm" (SFLA) that treats parameter optimization as a slow process and latent variable sampling as a fast process. They provide the first non-asymptotic, uniform-in-time convergence bounds for this approach, unifying several popular algorithms under a single theoretical framework.

What Problem Does This Paper Address?

In many modern statistical models (like those used for images or audio), we have observed data ($y$) and hidden latent variables ($x$). To find the best parameters ($\theta$), we want to maximize the marginal likelihood: the probability of the data after "averaging out" all possible values of the hidden variables.

The catch? That "averaging out" requires solving a high-dimensional integral that is usually impossible to calculate exactly.

The standard solution is the Expectation-Maximization (EM) algorithm, but its steps are often intractable. Researchers usually patch this by using Markov Chain Monte Carlo (MCMC) to approximate the hidden variables. While these "stochastic EM" methods work well in practice, we’ve lacked a unified theoretical way to analyze them—especially one that guarantees they won't drift into huge errors over long periods.

Methods

The authors propose looking at the problem through Stochastic Averaging. They design a system of two coupled Stochastic Differential Equations (SDEs):

  1. The Fast Process (The Sampler): This SDE moves very quickly (scaled by a small factor $\epsilon$). It explores the space of latent variables $x$.
  2. The Slow Process (The Optimizer): This SDE moves slowly. It updates the parameters $\theta$ based on the current state of the fast process.

The Magic of Scale Separation: As the fast process moves much quicker than the slow one, it effectively "reaches equilibrium" instantaneously from the perspective of the parameters. The slow process then moves according to the average behavior of the fast process, which the authors prove is equivalent to following the gradient of the log marginal likelihood.

What’s New? While "slow-fast" ideas exist in physics, the authors apply recent Uniform-in-Time (UiT) non-asymptotic bounds to this statistical setting. Most proofs only guarantee accuracy over a fixed time window; UiT bounds ensure the algorithm stays "on track" forever, which is vital for optimization.

Datasets

The authors evaluated their Slow-Fast Langevin Algorithm (SFLA) on two benchmarks:

  • Bayesian Logistic Regression: A standard statistical setup used to compare against the SOUL (Stochastic Unadjusted Langevin) algorithm.
  • Bayesian Neural Network: Using the MNIST dataset (specifically classifying digits 4 and 9) to test the algorithm in a more complex, high-dimensional setting.

Key Insights and Ideas

  • A Unified Theory: The paper shows that several disparate algorithms—like SOUL, Particle Gradient Descent (PGD), and Interacting Particle Langevin (IPLA)—are actually just different ways to discretize the same underlying multiscale SDE.
  • Efficiency through Coupling: You don't need to run a sampler to total convergence before every single parameter update. By coupling them at different speeds, the "noise" from the sampler naturally averages out as the optimizer moves.
  • Stability Matters: By using "Strong Exponential Stability" (SES) arguments, they prove that the error doesn't explode over time, even when the system is "stiff" (i.e., has very different time scales).

Key Results

  • Theoretical Convergence: They provide a concrete error bound showing that the distance between the algorithm's estimate and the true optimal parameter shrinks as the "speed" of the sampler increases ($\epsilon \to 0$) and the noise in the optimizer decreases ($\beta \to \infty$).
  • Empirical Performance: In tests, SFLA performed on par with state-of-the-art methods like SOUL and PGD.
  • Robustness: Even in the Bayesian Neural Network example—where the underlying math is non-convex and technically violates some of their theoretical assumptions—the algorithm still converged reliably to high-quality parameter estimates.

Limitations and Future Work

  • The Convexity Assumption: The primary mathematical proofs require the "potential" (the log-likelihood) to be strongly convex. Real-world deep learning models are notoriously non-convex. While the algorithm worked empirically on a neural network, the theoretical guarantee for those cases remains an open challenge.
  • Numerical Schemes: The authors used a simple Euler-Maruyama discretization. They acknowledge that for "stiff" multiscale systems, more advanced numerical methods (like splitting or implicit schemes) might be significantly faster and more stable.
  • Scaling Up: Future work could explore how this multiscale perspective handles extremely large datasets where "mini-batching" adds another layer of stochasticity to the system.

Summary updated

Abstract

In this paper, we provide a multiscale perspective on the problem of maximum marginal likelihood estimation. We consider and analyse a diffusion-based maximum marginal likelihood estimation scheme using ideas from multiscale dynamics. Our perspective is based on stochastic averaging; we make an explicit connection between ideas in applied probability and parameter inference in computational statistics. In particular, we consider a general class of coupled Langevin diffusions for joint inference of latent variables and parameters in statistical models, where the latent variables are sampled from a fast Langevin process (which acts as a sampler), and the parameters are updated using a slow Langevin process (which acts as an optimiser). We show that the resulting system of stochastic differential equations (SDEs) can be viewed as a two-time scale system. To demonstrate the utility of such a perspective, we show that the averaged parameter dynamics obtained in the limit of scale separation can be used to estimate the optimal parameter, within the strongly convex setting. We do this by using recent uniform-in-time non-asymptotic averaging bounds. Finally, we conclude by showing that the slow-fast algorithm we consider here, termed Slow-Fast Langevin Algorithm, performs on par with state-of-the-art methods on a variety of examples. We believe that the stochastic averaging approach we provide in this paper enables us to look at these algorithms from a fresh angle, as well as unlocking the path to develop and analyse new methods using well-established averaging principles.
BibTeX
@misc{akyldz2024multiscale,
  author = {Ömer Deniz Akyıldız and Iain Souttar and Michela Ottobre},
  title = {{A Multiscale Perspective on Maximum Marginal Likelihood Estimation}},
  year = {2024},
  eprint = {2406.04187},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2406.04187},
}
Figure