Marginal-Preserving Coupled Diffusion Composition for Long-Horizon Planning

Hengrui Zhang, Qiyu Wang, Yuhu Cheng, Brooks Paige, Xuesong WangarXiv 2026 · arXiv

TL;DR

Marginal-Preserving Coupled Diffusion Composition (MCDC) is a training-free inference method that fixes a major headache in long-horizon planning: "mode conflict." By introducing clever, correlated noise initializations that preserve the standard Gaussian marginals required by pretrained denoisers, MCDC ensures that stitched trajectory segments agree on which path to take in complex, multimodal environments—all with negligible computational overhead.

What Problem Does This Paper Address?

Diffusion models have become a powerhouse for trajectory planning, but they struggle with "long-horizon" tasks—reaching a goal that is much further away than any single trajectory in the training data. To solve this, researchers use compositional diffusion planners, which generate several short "chunks" of a trajectory and stitch them together.

The catch? In environments with multiple valid paths (multimodality), independent chunks often disagree. Imagine a maze where you can go left or right around a central pillar. Chunk 1 might decide to go left, while Chunk 2 independently decides to go right. When you stitch them together, you get a "teleportation" or a path that tries to phase through a wall.

Existing solutions usually involve expensive search (sampling hundreds of candidates and picking the best) or complex guidance (optimizing the path during denoising). These add significant latency and often require task-specific tuning.

Figure 1: A toy example showing how independent sampling leads to "mode conflict" (red paths) while MCDC promotes compatible stitching (green paths).

Methods

The authors propose MCDC, a "drop-in" modification to the sampling process. Instead of initializing each trajectory chunk with independent Gaussian noise, MCDC constructs coupled noise.

The key innovation is a specific linear combination of three noise types:

  1. Global Noise ($\epsilon_g$): Shared across all chunks to provide a coarse global "vibe."
  2. Edge Noise ($\epsilon_e$): Shared only between adjacent chunks to ensure local agreement at the stitch points.
  3. Private Noise ($\epsilon_{p,k}$): Unique to each chunk to maintain diversity.

Crucially, the authors prove that by carefully weighting these components, the marginal distribution of each chunk remains a standard Gaussian. This is vital because the pretrained diffusion model was only ever trained to denoise standard Gaussian noise; if the initialization looks "weird" to the model, the quality of the generated path collapses.

By introducing positive correlation between neighbors early in the denoising process, MCDC biases the chunks toward selecting the same "mode" (e.g., both choosing the left path) without needing to retrain the model or perform a costly search.

Datasets

The method was evaluated on the OGBench benchmark, specifically the "Stitch" tasks. These tasks are designed to test long-horizon planning by providing only short, fragmented trajectories in the training set. The environments include:

  • Locomotion: PointMaze, AntMaze, and HumanoidMaze (Medium, Large, and Giant sizes).
  • Object Interaction: AntSoccer (Arena and Medium settings).

The "Giant" mazes are particularly challenging, as they require stitching up to 11 segments into a single coherent plan.

Figure 5: The OGBench environments used for evaluation, ranging from simple point masses to complex humanoid locomotion and soccer tasks.

Key Insights and Ideas

  • Noise as a Coordination Channel: The initial noise in a diffusion process isn't just "randomness"—it's the seed that determines the final "mode" of the sample. Coordinating these seeds is a lightweight way to achieve global consistency.
  • Marginal Preservation is Non-Negotiable: You can't just add noise together haphazardly. If the variance of the initial noise deviates from 1.0, the pretrained denoiser (which expects a standard Gaussian) will produce garbage. MCDC’s mathematical framework ensures this constraint is met exactly.
  • Local vs. Global Coupling: The authors found that "local" coupling (between neighbors) is more effective for complex mazes than "global" coupling. It’s more important for a segment to agree with its immediate neighbor than with a segment ten steps away.
  • Complementary to Search: MCDC isn't just an alternative to search-based methods; it's a better starting point. Using MCDC-initialized noise before a guided search (like CDGS) yields even higher success rates.

Key Results

  • Success Rate Boost: On the most difficult tasks, like AntMaze-Giant, MCDC improved the success rate of the baseline (CompDiffuser) from 65.2% to 76.6%.
  • Efficiency: MCDC achieves these gains with nearly zero extra inference time. Compared to search-based methods (CDGS), MCDC is roughly 5.6x to 6.8x faster while often achieving better results.
  • Feasibility: Qualitative results show that MCDC significantly reduces "wall-crossing" failures. In PointMaze-Giant, MCDC reduced fusion-induced failures from 22.8% down to just 5.6%.
Figure 3: Qualitative comparison. Decision Diffuser (DD) often ignores walls. CompDiffuser (CD) respects walls locally but fails at stitches. MCDC produces globally coherent, wall-valid plans.

Limitations and Future Work

  • Bounded by the Denoiser: MCDC can't fix a bad model. If the underlying diffusion model is incapable of generating a specific turn or movement, no amount of noise coupling will help.
  • Hyperparameter Sensitivity: The coupling strengths ($\rho_g, \rho_l$) are currently fixed hyperparameters. While the authors provide a sensitivity analysis (Figure 4), future work could involve dynamically adapting these strengths based on the environment or the "uncertainty" of the denoiser.
  • Beyond Chain Graphs: Currently, MCDC is applied to sequential chunks (a chain graph). Extending this to more complex tree-like or graph-based planning structures is a promising next step.
Figure 4: Sensitivity analysis of coupling strengths. The results show a broad "sweet spot" for the weights, suggesting the method is relatively robust.

Summary updated

Abstract

Compositional diffusion planners extend short-horizon trajectory models to long-horizon goal-conditioned planning by generating and stitching multiple local trajectory chunks. However, in multimodal environments, local plausibility is not sufficient for global consistency: independently initialized chunks may denoise toward incompatible overlap modes, producing plans that are individually feasible but incoherent after stitching. Existing remedies typically add search, guidance, pruning, or graph-based structure at inference time, increasing computational cost or relying on task-specific machinery. We instead investigate graph-structured dependence among chunk-wise initial diffusion noises as a lightweight coordination mechanism for compositional trajectory planning. We propose \textbf{M}arginal-Preserving \textbf{C}oupled \textbf{D}iffusion \textbf{C}omposition (MCDC), a training-free inference method for pretrained compositional diffusion planners. Instead of sampling chunk noises independently, MCDC constructs coupled Gaussian initializations whose per-chunk marginals remain exactly standard Gaussian, as required by the pretrained denoiser, while neighboring chunks receive positively correlated noise components. This preserves the standard-Gaussian initialization marginal of each chunk while biasing adjacent chunks toward compatible overlap-mode choices. We prove exact marginal preservation and show, under a simple multimodal overlap model, that positive coupling increases the probability of compatible mode selection. On OGBench long-horizon stitch tasks, MCDC consistently improves over independent compositional diffusion sampling while retaining nearly the same inference time, and achieves a favorable success--cost trade-off compared with search-based composition methods.
BibTeX
@misc{zhang2026marginal,
  author = {Hengrui Zhang and Qiyu Wang and Yuhu Cheng and Brooks Paige and Xuesong Wang},
  title = {{Marginal-Preserving Coupled Diffusion Composition for Long-Horizon Planning}},
  year = {2026},
  eprint = {2611.15585},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.15585},
}
Figure