A New Combined Prediction Model for Ultra-Short-Term Wind Power Based on Variational Mode Decomposition and Gradient Boosting Regression Tree

Feng Xing, Xiaoyu Song, Yübo Wang, Caiyan QinSustainability 2023 · DOI

TL;DR

This paper introduces a novel hybrid model for ultra-short-term wind power prediction that combines Variational Mode Decomposition (VMD) with optimized Support Vector Machines (SVM) and Gated Recurrent Unit-Long Short-Term Memory (GRU-LSTM) networks, further enhanced by Gradient Boosting Regression Trees (GBRT) for residual prediction. The proposed model achieves superior accuracy by decomposing the complex wind power signal into distinct components and leveraging specialized models for each, outperforming existing methods.

What Problem Does This Paper Address?

The increasing integration of renewable energy sources like wind power into the grid presents a significant challenge due to its inherent volatility, randomness, and non-linearity. Accurate ultra-short-term wind power prediction is crucial for stable grid operation, economic dispatch, and effective energy management. Traditional single-algorithm prediction methods often struggle to capture the complex dynamics of wind power, leading to suboptimal accuracy. This paper aims to address this by developing a more robust and accurate prediction model that can better handle the intricate patterns within wind power data.

Methods

The core of the proposed method lies in a multi-stage approach:

  • Variational Mode Decomposition (VMD): This technique is used to decompose the raw wind power signal into three distinct components: a long-term trend, a short-term component, and a random component. VMD is chosen for its ability to effectively avoid mode mixing and endpoint effects, which are common issues with other decomposition methods like Empirical Mode Decomposition (EMD).
  • Particle Swarm Optimization (PSO): PSO is employed to optimize the hyperparameters of the predictive models. Specifically, it tunes the parameters for SVM and GRU-LSTM to enhance their predictive capabilities.
  • PSO-SVM: This module is used to predict the long-term and short-term components identified by VMD. SVM is chosen for its effectiveness in handling data with relatively small volatility and good smoothness.
  • PSO-GRU-LSTM: This module is designed to predict the random component, which is characterized by high volatility and noise. The GRU-LSTM hybrid architecture combines the faster training speed of GRU with the higher prediction accuracy of LSTM.
  • Gradient Boosting Regression Tree (GBRT): After predicting the individual components, GBRT is used to predict the residuals (the difference between the actual and predicted values of the combined components). This step further refines the overall prediction accuracy.
  • Ensemble Prediction: Finally, the predicted values from the PSO-SVM, PSO-GRU-LSTM, and GBRT models are aggregated to produce the final ultra-short-term wind power prediction.

Datasets

The study utilizes a publicly available dataset from a 16 MW wind power plant. The data was sampled at 5-minute intervals, with 8928 historical data points from January used for training and 24 data points from February 1st used for rolling prediction. A second dataset from a 2254.4 MW wind farm, sampled at 15-minute intervals with 2976 data points from March, was also used for further validation.

Key Insights and Ideas

  • Decomposition is Key: The paper strongly advocates for decomposing the complex wind power signal. By separating the long-term, short-term, and random components, specialized models can be applied to each, leading to significantly improved overall prediction accuracy.
  • Hybrid Models Excel: Combining different AI techniques (VMD, PSO, SVM, GRU-LSTM, GBRT) is more effective than using any single method. Each component of the hybrid model plays a crucial role in capturing different aspects of the wind power signal.
  • PSO for Optimization: The use of PSO to tune the hyperparameters of SVM and GRU-LSTM is critical for maximizing their predictive power, especially for the more volatile random component.
  • GBRT for Residuals: Employing GBRT to predict the residuals after initial component-wise prediction is a clever way to capture and correct any remaining errors, further boosting accuracy.

Key Results

The proposed combined model demonstrated superior performance compared to several baseline models (BP, LSTM, PSO-LSTM, PSO-GRU-LSTM, Model I, Model II, Model III).

  • Overall Performance: The final proposed model (Model IV) achieved a Mean Squared Error (MSE) of 0.0244, a Mean Absolute Error (MAE) of 0.1185, and a Coefficient of Determination (R²) of 0.9821.
  • VMD Advantage: Models incorporating VMD consistently outperformed those without it. For instance, Model II (PSO-GRU-LSTM with VMD) showed a lower MSE by 0.0115 and MAE by 0.0029 compared to PSO-GRU-LSTM without VMD.
  • Component-wise Improvements:
    • PSO-GRU-LSTM outperformed PSO-LSTM for the random component.
  • Model III (two PSO-SVM for long/short-term, one PSO-GRU-LSTM for random) showed significant improvement over Model II, indicating the benefit of using SVM for less volatile components.
  • Model IV (adding GBRT for residuals to Model III) further improved accuracy, reducing MSE by 0.0042 and MAE by 0.022.

Limitations and Future Work

The authors acknowledge a few limitations:

  • PSO Local Optima: The PSO algorithm can occasionally get trapped in local optima, which might affect the optimization process.
  • Scale Dependency: The model's prediction accuracy for large-scale wind power plants was slightly lower compared to small-scale ones.

Future work could explore more advanced optimization algorithms to overcome the local optima issue with PSO and investigate how to further adapt the model for different scales of wind power generation.

Summary updated

Abstract

Wind power is an essential component of renewable energy. It enables the conservation of conventional energy sources such as coal and oil while reducing greenhouse gas emissions. To address the stochastic and intermittent nature of ultra-short-term wind power, a combined prediction model based on variational mode decomposition (VMD) and gradient boosting regression tree (GBRT) is proposed. Firstly, VMD is utilized to decompose the original wind power signal into three meaningful components: the long-term component, the short-term component, and the randomness component. Secondly, based on the characteristics of these three components, a support vector machine (SVM) is selected to predict the long-term and short-term components, while gated recurrent unit-long short-term memory (GRU-LSTM) is employed to predict the randomness component. Particle swarm optimization (PSO) is utilized to optimize the structural parameters of the SVM and GRU-LSTM combination for enhanced prediction accuracy. Additionally, a GBRT model is employed to predict the residuals. Finally, the rolling predicted values of the three components and residuals are aggregated. A deep learning framework using TensorFlow 2.0 has been built on the Python platform, and a dataset measured from a wind farm has been utilized for learning and prediction. The comparative analysis reveals that the proposed model exhibits superior short-term wind power prediction performance, with a mean squared error, mean absolute error, and coefficient of determination of 0.0244, 0.1185, and 0.9821, respectively.
BibTeX
@inproceedings{xing2023new,
  author = {Feng Xing and Xiaoyu Song and Yübo Wang and Caiyan Qin},
  title = {{A New Combined Prediction Model for Ultra-Short-Term Wind Power Based on Variational Mode Decomposition and Gradient Boosting Regression Tree}},
  booktitle = {Sustainability},
  year = {2023},
  doi = {10.3390/su151411026},
}
Figure