Scenario Forecasting of Residential Load Profiles

Ling Zhang, Baosen Zhang

TL;DR

This paper introduces a novel approach to residential load forecasting by generating multiple "plausible futures" (scenarios) rather than a single, often inaccurate, point estimate. By leveraging flow-based conditional generative models with a custom "reinforced" architecture and Wasserstein distance regularization, the authors produce forecasts that are both more diverse and more representative of actual household behavior than traditional statistical methods.

What Problem Does This Paper Address?

Forecasting electricity demand for a single household or a small group is notoriously difficult. Unlike city-wide loads, which are smooth and predictable, residential loads are highly volatile due to the randomness of human behavior (e.g., when someone decides to turn on a dryer or charge an EV).

Standard "point forecasts" (predicting a single value for a future time) often fail because they can't capture this uncertainty. If a utility operator only has one guess, they can't plan for "what if" scenarios. Existing methods to solve this—like adding random noise to a point forecast—often produce unrealistic results that don't capture the complex temporal patterns of real energy usage.

Methods

The authors propose using Conditional Normalizing Flows, specifically building on the Glow architecture. Unlike GANs, which can be unstable to train, flow-based models learn to map complex data distributions to a simple Gaussian distribution through a series of reversible transformations.

The paper introduces two key technical innovations:

  1. Reinforced-flow Architecture: In standard "vanilla" flows, only a portion of the data is transformed based on the conditional input (the historical load). The authors' "reinforced" design ensures that all parts of the transformation are tightly coupled with the historical data, allowing the model to better capture how past behavior influences future patterns.
  2. Wasserstein Regularization: Maximum Likelihood Estimation (which flows typically use) tends to produce "spread out" distributions to cover all possible data points. The authors add a weighted Wasserstein distance metric to the training objective. This acts as a regularizer, helping the model concentrate its predictions more realistically around the most likely realizations without losing necessary diversity.

Datasets

The study utilizes the Dataport dataset from the Pecan Street Corporation.

  • Scope: Hourly household power consumption from January 2013 to December 2017.
  • Location: Austin, Texas.
  • Scale: Data from 105 consistent households.
  • Usage: Data from 2013–2016 was used for training/validation, while the last three months of 2017 served as the test set. The models were tested across different aggregation levels: single households, 10 households, and 100 households.

Key Insights and Ideas

  • Diversity vs. Accuracy: The goal isn't just to be "right" on average, but to generate a set of scenarios that cover the true range of possible behaviors. The flow-based model excels here because it models the entire probability density function (PDF).
  • The "Reinforced" Advantage: By strengthening the coupling between the conditional input (past load) and the output (future load), the model becomes much more sensitive to sudden changes in usage patterns, such as a shift in peak demand timing.
  • The KL-Divergence Trap: Standard training (minimizing KL-divergence) often leads to models that are "too safe," creating scenarios with excessively high variance. Adding the Wasserstein distance helps "sharpen" the scenarios, making them more physically plausible.

Key Results

  • Superior Reliability: Using "Deviation-Coverage Area" plots, the authors showed that their flow-based models (especially the reinforced version) stayed much closer to the origin than standard Autoregressive (AR) models with added noise, indicating higher reliability.
  • Sharpness: The 50% prediction intervals generated by the flow models were "sharper"—meaning they were narrower during predictable periods (like late-night base loads) and wider during volatile periods (like afternoon peaks). Traditional methods produced a constant-width "belt" of uncertainty that didn't reflect reality.
  • Visual Realism: Qualitatively, the generated scenarios look like real load profiles, capturing the "spiky" nature of residential demand that smoothed-out point forecasts miss.

Limitations and Future Work

  • Sensitivity to Noisy History: The authors acknowledge that if the historical data used for conditioning is "too noisy" (i.e., contains no discernible pattern), the model struggles. In these cases, it tends to ignore the history and generate "average" scenarios that may not match the specific day's realization.
  • Computational Complexity: While flow-based models are efficient for sampling, the "reinforced" architecture adds more parameters and complexity to the training phase compared to vanilla flows.
  • Future Directions: The authors suggest that incorporating additional side information—such as weather data, occupancy sensors, or appliance-level data—could further improve the conditioning and help the model handle the "noisy history" problem.

Summary updated

Abstract

Load forecasting is an integral part of power system operations and planning. Due to the increasing penetration of rooftop PV, electric vehicles and demand response applications, forecasting the load of individual and a small group of households is becoming increasingly important. Forecasting the load accurately, however, is considerable more difficult when only a few households are included. A way to mitigate this challenge is to provide a set of scenarios instead of one point forecast, so an operator or utility can consider a range of behaviors. This paper proposes a novel scenario forecasting approach for residential load using flow-based conditional generative models. Compared to existing scenario forecasting methods, our approach can generate scenarios that are not only able to infer possible future realizations of residential load from the observed historical data but also realistic enough to cover a wide range of behaviors. Particularly, the flow-based models utilize a flow of reversible transformations to maximize the value of conditional density function of future load given the past observations. In order to better capture the complex temporal dependency of the forecasted future load on the condition, we extend the structure design for the reversible transformations in flow-based conditional generative models by strengthening the coupling between the output and the conditional input in the transformations. The simulation results show the flow-based designs outperform existing methods in scenario forecasting for residential load by both providing more accurate and more diverse scenarios.
BibTeX
@article{zhang2020scenario,
  author = {Ling Zhang and Baosen Zhang},
  title = {{Scenario Forecasting of Residential Load Profiles}},
  journal = {IEEE J. Sel. Areas Commun.},
  year = {2020},
  url = {https://openreview.net/forum?id=OxKSZbsO0K},
}

Loading related content...

Figure