Vertical Power Flow Forecast with LSTMs Using Regular Training Update Strategies

Katharina Brauns, Christoph Scholz, André Baier, Dominik Jöst

TL;DR

This paper introduces a deep learning approach using Long Short-Term Memory (LSTM) networks to forecast "vertical power flow"—the electricity moving between medium and high-voltage grids. By implementing a daily retraining strategy, the authors successfully account for sudden changes in grid characteristics (like new wind farms or maintenance), achieving an average 8% improvement in forecast accuracy over static models.

What Problem Does This Paper Address?

The transition to renewable energy has turned the electrical grid from a predictable system into a volatile one. Historically, power flowed from large, centralized plants down to consumers, following well-understood "standard load profiles." Today, the rise of wind and solar—often connected at lower voltage levels—plus the adoption of EVs and battery storage, has made power flow bidirectional and highly fluctuating.

The authors focus specifically on vertical power flow: the electricity passing through transformers between voltage levels (e.g., medium-voltage to high-voltage). Forecasting this is notoriously difficult because the "ground truth" behavior of a transformer can change overnight due to:

  • Dynamic grid topologies: Switching states within the grid.
  • New assets: A new solar park suddenly coming online.
  • Maintenance: Temporary bypasses or transformer exchanges.

Static machine learning models fail here because they are trained on historical data that no longer represents the current state of the grid—a phenomenon known as "concept drift."

Methods

The researchers deployed a specialized LSTM (Long Short-Term Memory) architecture, a type of recurrent neural network designed to capture long-term dependencies in time-series data.

The Architecture

The model uses a dual-input approach:

  1. Input 1: Historical vertical power flow measurements.
  2. Input 2: Exogenous variables including numerical weather forecasts (temperature, wind speed, solar radiation), sun position, and time-of-day/day-of-week metadata.

These inputs are processed through parallel LSTM layers, concatenated, and passed through dense layers with dropout (to prevent overfitting) before reaching the final output layer, which predicts a 48-hour horizon at 15-minute intervals.

The Innovation: Regular Training Update Strategies

The core contribution is the Regular Training Update Strategy. Instead of using a static model, the authors retrain the model daily as new measurements arrive. They investigated several "update strategies" by varying:

  • Epochs: How many times the model sees the new data (5, 10, 15, or 20).
  • Learning Rates: How aggressively the model adjusts its weights (0.01 vs 0.001).

The goal was to "nudge" the model to prioritize recent changes in transformer behavior without erasing the foundational patterns it learned during initial training.

Datasets

The study utilized data from seven transformers selected from the EU-SysFlex project.

  • Power Data: 15-minute resolution measurements of vertical power flow.
  • Weather Data: Forecasts from the European Centre for Medium-Range Weather Forecasts (ECMWF) with a 9km spatial resolution and 3-hour time resolution.
  • Timeframe: Training data spanned from January 2016 to May 2018, with specific test periods used to evaluate the update strategy's ability to handle characteristic shifts.

Key Insights and Ideas

  • Recency vs. History: The "aha moment" is that the model doesn't need a massive overhaul to handle grid changes. A small amount of daily retraining (just 5 epochs) was more effective than longer retraining sessions. This suggests that "light" updates are sufficient to capture concept drift without causing the model to overfit to noise in the new data.
  • The "Step Change" Problem: The paper highlights a specific case where a transformer's behavior changed drastically in early 2018 (likely due to new generation assets). The static LSTM's predictions were consistently too low, but the regularly updated LSTM "caught up" to the new reality within days.
  • Simplicity in Baselines: The authors compared their model against "Persistence" models (predicting that tomorrow will look exactly like today). While persistence is often hard to beat for very short-term horizons (1 hour), the LSTM with updates significantly outperformed it as the forecast horizon extended to 48 hours.

Key Results

  • Overall Accuracy: The regular update process provided an average improvement of 8% in forecast quality across all transformers.
  • Optimal Strategy: The best performance was generally achieved using 5 epochs and a learning rate of 0.001 for the daily updates.
  • Transformer Variability: Results were not uniform. For four transformers, the update strategy yielded a mean improvement of over 7.5%. However, for three others, there was a slight performance reduction (average 1.2%), suggesting that the benefit of retraining depends heavily on how much the underlying grid characteristics are actually changing.

Limitations and Future Work

  • Negative Gains: As noted, some transformers saw a slight decrease in accuracy with updates. The authors suggest that if a transformer's behavior is stable, daily retraining might introduce unnecessary noise.
  • Transfer Learning: The authors identify transfer learning as a promising next step—using knowledge from one transformer to improve forecasts on a newly installed one where historical data is scarce.
  • Architectural Exploration: While LSTMs performed well, the authors briefly mentioned that initial tests with Encoder-Decoder architectures (like ConvLSTM2D) did not yield better results, suggesting more work is needed to find the "perfect" architecture for this specific spatial-temporal problem.
  • Long-term Evaluation: The study focused on a specific test window; further research is needed to see how these update strategies hold up over several years of varying seasonal patterns.

Summary updated

Abstract

The strong growth of renewable energy sources and the high volatility in power generation of these sources, as well as the increasing amount of volatile energy consumption is leading to major challenges in the electrical grid. In order to ensure safety and reliability in the electricity grid, the power flow in the grid needs to be observed to prevent overloading. Furthermore, the energy supply and consumption need to be continuously balanced to ensure the security of energy supply. Therefore a high quality of power flow forecasts for the next few hours within the grid are needed. In this paper we investigate forecasts of the vertical power flow at transformer between the medium and high voltage grid. Forecasting the vertical power flow is challenging due to constantly changing characteristics of the power flow at the transformer. This is mainly a result of dynamic grid topologies, changes in the installed assets, maintenance of the transformer itself as well as the volatile generation. In this paper we present a novel approach to deal with these challenges. For the multi step time series forecasts a Long-Short Term Memory (LSTM) is used. In our presented approach an update process where the model is retrained regularly is investigated and compared to baseline models. The model is retrained as soon as a sufficient amount of new measurements are available. This retraining should capture changes in the characteristic of the transformer that the model has not yet seen in the past and therefore cannot be predicted by the model. For the regular update process we investigate different strategies where especially the number of used epochs are considered, but also different learning rates are used. We show that our new approach significantly outperforms the investigated baseline approaches.
BibTeX
@inproceedings{brauns2022vertical,
  author = {Katharina Brauns and Christoph Scholz and André Baier and Dominik Jöst},
  title = {{Vertical Power Flow Forecast with LSTMs Using Regular Training Update Strategies}},
  booktitle = {Energy},
  year = {2022},
  doi = {10.1016/j.egyai.2022.100143},
}
Figure