Trans-dimensional MCMC for Variable Model Spaces

You are reading version 1 of this direction, frozen 2026-10-04. The latest version is version 2.

Version 1 of 2119 papers134 conceptsfrozen 2026-10-04

In standard Bayesian inference, we typically assume our model has a fixed number of parameters. We might estimate the weights of a neural network or the mean of a distribution, but the structure of the model—the number of hidden units or the number of clusters—is usually decided beforehand.

However, real-world data rarely tells us its complexity upfront. If we are clustering data, how many clusters are there? If we are detecting change points in a time series, how many shifts occurred? Trans-dimensional Markov Chain Monte Carlo (MCMC) provides a framework for the sampler to "jump" between parameter spaces of different dimensions, allowing the model to learn its own complexity directly from the data.

The Challenge of Changing Dimensions

Standard MCMC algorithms like Metropolis-Hastings work by exploring a state space of fixed dimensionality. If you try to move from a 2D space to a 3D space, the standard transition rules break because the probability densities in different dimensions are not directly comparable.

As Christophe Andrieu, Nando de Freitas, and Michael I. Jordan explain in An Introduction to MCMC for Machine Learning, trans-dimensional MCMC treats the model index (and thus its dimensionality) as just another random variable to be sampled. This allows for simultaneous model selection and parameter estimation. Instead of running ten different models with 1 to 10 clusters and comparing them, a single trans-dimensional chain can explore all of them, spending more time in the models that best fit the data.

Reversible Jumps and Dimension Matching

The most common mechanism for these transitions is Reversible-Jump MCMC (RJMCMC). To move between a model with $k$ parameters and one with $k+1$ parameters, we must maintain "detailed balance"—ensuring the probability of jumping "up" is balanced by the probability of jumping "back."

The key intuition, applied by Alan D. Marrs in An Application of Reversible-Jump MCMC to Multivariate Spherical Gaussian Mixtures, is dimension matching. When jumping to a higher dimension, we generate auxiliary random variables to "pad" the lower-dimensional space until the dimensions match. This transformation must be differentiable and reversible (a bijection), allowing us to calculate a Jacobian term that corrects the acceptance probability for the change in volume between spaces.

Common Moves: Birth, Death, Split, and Merge

To navigate these varying landscapes, researchers design specific "moves" that propose changes to the model structure:

Improving Efficiency with Pseudo-Priors

A major hurdle in trans-dimensional sampling is the "rejection problem." If you jump into a high-dimensional space with random parameters, the new model will likely fit the data poorly and be rejected, leaving the chain stuck.

To solve this, Seonghyun Jeong, Taeyoung Park, and David A. van Dyk in Bayesian model selection in additive partial linear models via locally adaptive splines employ pseudo-priors. These are proposal distributions for the "inactive" parameters. By carefully choosing these pseudo-priors to be near the likely posterior values, the sampler can propose "sensible" jumps that are much more likely to be accepted.

Beyond Metropolis: Slice and Hamiltonian Jumps

While RJMCMC is the standard, newer methods adapt more powerful samplers to trans-dimensional spaces:

  • Transdimensional Slice Sampling: Razvan Ranca introduced this in StocPy to handle probabilistic programs where the number of random variables changes during execution.
  • Nonparametric Hamiltonian Monte Carlo (NP-HMC): Carol Mak and Luke Ong developed Nonparametric Involutive MCMC, which uses "dynamic padding" with noise to make execution traces of different lengths dimensionally compatible. This allows gradient-based HMC to work even when the number of variables is unknown.

Why It Works: The Automatic Occam's Razor

Trans-dimensional MCMC works because it inherently respects Occam's Razor. In a Bayesian framework, higher-dimensional models are "penalized" because their prior probability mass is spread over a much larger volume.

As shown by Gergo Orbán and Máté Lengyel in Bayesian model learning in human visual perception, this allows the system to discover the simplest structure that explains the data. By treating the model architecture itself as a parameter, we move from "fitting a model to data" to "letting the data build the model."

Papers in this version

Showing 60 of 119 papers.

History & citationVersion 2 · 2026-10-04

Current · Permanent link

  1. Version 2 (latest) · 2026-10-04 · 149 papers
  2. Version 1 · 2026-10-04 · 119 papers
Cite this direction

Latest version (a living page):

@misc{lacuna_reversible_jump_mcmc_fa9fc756,
  title = {reversible jump MCMC},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/reversible-jump-mcmc/rdr_fa9fc756da1540e7a831091ff10ca803},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}

This exact version (version 1, frozen text):

@misc{lacuna_trans_dimensional_mcmc_for_variable_mode_fa9fc756_v1,
  title = {Trans-dimensional MCMC for Variable Model Spaces},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/trans-dimensional-mcmc-for-variable-model-spaces/rdr_fa9fc756da1540e7a831091ff10ca803/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}