Diffusion-Based Scenario Tree Generation for Multivariate Time Series Prediction and Multistage Stochastic Optimization

Stelios Zarifis, Ioannis Kordonis, Petros MaragosarXiv 2025 · DOI · arXiv

Introduction

In complex decision-making environments such as finance, energy markets, and robotics, optimal actions today depend on a range of possible future trajectories. Traditional forecasting models, including Vector Autoregression (VAR) or Long Short-Term Memory (LSTM) networks, often struggle to capture the multimodal nature of future uncertainties. While modern diffusion-based generative models excel at producing high-fidelity probabilistic forecasts, they typically generate an unstructured set of scenarios. This paper introduces the Diffusion Scenario Tree (DST) framework, which bridges the gap between high-fidelity diffusion forecasts and the structured requirements of multistage stochastic optimization.

The DST Framework

To utilize probabilistic forecasts in Stochastic Model Predictive Control (MPC), information must be organized into a Scenario Tree. This structure is critical for enforcing "non-anticipativity"—the logical constraint that decisions made at a specific time cannot rely on information revealed in the future.

The hierarchical structure of a scenario tree, illustrating realized observations and decision nodes across stages.

The authors propose a recursive algorithm to construct these trees:

  1. Probabilistic Forecasting: An autoregressive diffusion model (TimeGrad) samples multiple future trajectories conditioned on historical data.
  2. Clustering for Structure: At each stage, sampled trajectories are grouped via K-means clustering. The resulting centroids serve as the tree's nodes, representing representative future states.
  3. Probability Assignment: Branch probabilities are determined by the density of samples within each cluster.
  4. Pruning: To maintain computational tractability, only the top-$L$ child nodes with the highest cumulative probability are retained.
  5. MPC Integration: The resulting tree is fed into a Multistage Stochastic MPC solver, which optimizes actions across all branches simultaneously.

Experimental Evaluation: Energy Arbitrage

The framework was evaluated on a real-world energy arbitrage task using 10 months of hourly electricity price data from the New York State day-ahead market. The objective was to manage a simulated Battery Energy Storage System (BESS), buying electricity when prices are low and selling when they are high, while accounting for battery degradation.

Results and Discussion

The DST-guided MPC was compared against several benchmarks, including Oracle MPC (perfect future knowledge) and traditional tree-generation methods based on LSTMs and VAR models.

Comparative performance of DST MPC against various benchmarks across different months, showing total rewards and averages.

As shown in the results table, DST-MPC achieved a total reward of 858.09, significantly outperforming LSTM-based trees (727.32) and VAR-based trees (684.58). Notably, DST-MPC performed remarkably close to the Oracle MPC (889.30), demonstrating its ability to capture complex market dynamics.

Key insights from the study include:

  • Structure Matters: Organizing predictions into a tree yields superior policies compared to unstructured Monte Carlo sampling, even when using the same underlying diffusion model.
  • Data Efficiency: DST produces more stable and effective policies than model-free Reinforcement Learning (RL) baselines, such as DQN, which struggled in this low-data regime (averaging only 26.92).
  • Interpretability: Unlike "black-box" predictors, the scenario tree allows human operators to visualize the specific future scenarios the controller is hedging against.

Conclusion and Future Work

While the DST framework offers significant performance gains, the iterative denoising process of diffusion models introduces computational latency. Future research will explore faster sampling variants like DDIM or DPM-Solver++ to enable real-time applications. Additionally, the authors suggest moving toward "problem-driven" tree generation, where the tree structure is optimized specifically to satisfy the physical constraints of the underlying system.

Summary updated

Abstract

Stochastic forecasting is critical for efficient decision-making in uncertain systems, such as energy markets and finance, where estimating the full distribution of future scenarios is essential. We propose Diffusion Scenario Tree (DST), a general framework for constructing scenario trees using diffusion-based probabilistic forecasting models to provide a structured model of system evolution for control tasks. DST recursively samples future trajectories and organizes them into a tree via clustering, ensuring non-anticipativity (decisions depending only on observed history) at each stage, offering a superior representation of uncertainty compared to using predictive models solely for forecasting system evolution. We integrate DST into Model Predictive Control (MPC) and evaluate it on energy arbitrage in New York State's day-ahead electricity market. Experimental results show that our approach significantly outperforms the same optimization algorithms that use scenario trees generated by more conventional models. Furthermore, using DST for stochastic optimization yields more efficient decision policies by better handling uncertainty than deterministic and stochastic MPC variants using the same diffusion-based forecaster, and simple Model-Free Reinforcement Learning (RL) baselines.
BibTeX
@misc{zarifis2025diffusion,
  author = {Stelios Zarifis and Ioannis Kordonis and Petros Maragos},
  title = {{Diffusion-Based Scenario Tree Generation for Multivariate Time Series Prediction and Multistage Stochastic Optimization}},
  year = {2025},
  eprint = {2509.14832},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2509.14832},
}
Figure