Prediction for the Sluice Deformation Based on SOA-LSTM-Weighted Markov Model

Jianhe Peng, Wei Xie, Yue Wu, Xiaoran Sun, Chunlin Zhang, Hao Gu, Mingyuan Zhu, Sen ZhengWater 2023 · DOI

TL;DR

This paper introduces a novel hybrid model, SOA-LSTM-Weighted Markov, for predicting sluice deformation. By combining the predictive power of LSTM with the error-correction capabilities of a weighted Markov model, and optimizing LSTM's hyperparameters with the Seagull Optimization Algorithm (SOA), the approach significantly improves prediction accuracy for complex, time-varying deformation data.

What Problem Does This Paper Address?

Sluices are critical hydraulic structures, and their deformation is a key indicator of structural health. Predicting this deformation is crucial for safety and maintenance, but traditional statistical models struggle with the complex, non-linear, and long-term dependencies present in monitoring data. Existing advanced models like LSTM can capture these complexities but may still have limitations in handling highly volatile or noisy data. This paper aims to bridge this gap by developing a more robust and accurate prediction model for sluice deformation that can effectively handle these challenges.

Methods

The core of this research lies in a three-pronged approach:

  • Long Short-Term Memory (LSTM) Network: This recurrent neural network is chosen for its ability to learn from sequential data and capture long-term dependencies, which are common in deformation monitoring.
  • Seagull Optimization Algorithm (SOA): This bio-inspired optimization algorithm is employed to fine-tune the hyperparameters of the LSTM network. This is crucial because LSTM has many parameters (e.g., number of hidden layers, learning rate) that significantly impact performance, and manual tuning is time-consuming and often suboptimal. SOA automates this process, aiming to find the optimal configuration for better accuracy and efficiency.
  • Weighted Markov Model: After the SOA-LSTM model predicts the deformation, its residual errors are analyzed. The weighted Markov model is then used to correct these errors. This approach leverages the Markov chain's ability to handle random sequences with high volatility and incorporates the strength of dependencies across different time lags, further refining the prediction.

The overall process involves establishing the SOA-LSTM model, analyzing its error sequences, constructing the weighted Markov model based on these errors, and finally combining them to form the SOA-LSTM-Weighted Markov model.

Datasets

The study utilizes settlement monitoring data from a regulating sluice with 12 holes at the Bengbu sluice project in China. The data was collected from March 10, 2021, with measurements taken every 30 days. For model training and evaluation, 80% of the data was used for training, and the remaining 20% was used for testing. The paper specifically analyzes data from four monitoring points (2-2, Lr-2, Ul-2, and 5-1) and presents detailed results for monitoring point 5-1.

Key Insights and Ideas

  • Hybridization is Key: The paper strongly suggests that combining deep learning (LSTM) with statistical time-series methods (Weighted Markov) and advanced optimization (SOA) is more effective than using any single method alone for complex deformation prediction.
  • Hyperparameter Optimization Matters: The performance of deep learning models like LSTM is highly sensitive to hyperparameter choices. Using an intelligent optimization algorithm like SOA is essential for unlocking their full potential.
  • Error Correction is Crucial: Even powerful models like LSTM can leave residual errors. A weighted Markov model can effectively capture and correct these errors, leading to a significant boost in overall prediction accuracy, especially for volatile data.
  • Sluice Deformation is Inherently Non-linear: The study highlights that sluice settlement exhibits non-linear trends over time, making traditional linear models insufficient.

Key Results

The proposed SOA-LSTM-Weighted Markov model demonstrated superior performance compared to the stepwise regression model and the SOA-LSTM model:

  • Highest R² values: The model achieved the highest coefficient of determination (R²) across all four monitoring points, indicating a strong fit to the data. R² values ranged from 0.9301 to 0.9951.
  • Smallest RMSE: The Root Mean Square Error (RMSE) was consistently the lowest for the proposed model, ranging from 0.725 to 1.517 across the monitoring points.
  • Lowest Absolute Relative Errors: The average absolute relative errors for the stepwise regression, SOA-LSTM, and SOA-LSTM-Weighted Markov models were 7.55%, 3.12%, and 1.57%, respectively. This clearly shows the proposed model's enhanced accuracy.
  • Effective for Volatile Data: The model proved particularly effective in fitting and predicting larger fluctuations in sluice settlement, demonstrating its suitability for volatile monitoring data.

Limitations and Future Work

  • Data Regularity: The authors note that the prediction accuracy of the SOA-LSTM and SOA-LSTM-Weighted Markov models is higher due to the "better regularity of the actual data series selected." This implies that performance might vary with datasets exhibiting less predictable patterns.
  • Data Volume: They suggest that as more monitoring data becomes available, prediction models should be continuously trained and adjusted to maintain accuracy for long-term predictions.
  • Physics-Data Driven Models: The study focuses on a data-driven approach. The authors propose that future work should explore physics-data double-driven intelligent prediction models, which could potentially offer even more robust and interpretable predictions.
  • Broader Application: The paper suggests the proposed model has prospective applications in the deformation prediction of more sluice projects to enhance safety monitoring efficiency.

Summary updated

Abstract

Increasingly, deformation prediction has become an essential research topic in sluice safety control, which requires significant attention. However, there is still a lack of practical and efficient prediction modeling for sluice deformation. In order to address the limitations in mining the deep features of long-time data series of the traditional statistical model, in this paper, an improved long short-term memory (LSTM) model and weighted Markov model are introduced to predict sluice deformation. In the method, the seagull optimization algorithm (SOA) is utilized to optimize the hyper-parameters of the neural network structure in LSTM primarily to improve the model. Subsequently, the relevant error sequences of the fitting results of SOA-LSTM model are classified and the Markovity of the state sequence is examined. Then, the autocorrelation coefficients and weights of each order are calculated and the weighted and maximum probability values are applied to predict the future random state of the sluice deformation. Afterwards, the prediction model of sluice deformation on the SOA-LSTM-weighted Markov model is proposed. Ultimately, the presented model is used to predict the settlement characteristics of an actual sluice project in China. The analysis results demonstrate that the proposed model possesses the highest values of R2 and the smallest values of RMSE and absolute relative errors for the monitoring data of four monitoring points. Consequently, it concluded that the proposed method shows better prediction ability and accuracy than the SOA-LSTM model and the stepwise regression model.
BibTeX
@inproceedings{peng2023prediction,
  author = {Jianhe Peng and Wei Xie and Yue Wu and Xiaoran Sun and Chunlin Zhang and Hao Gu and Mingyuan Zhu and Sen Zheng},
  title = {{Prediction for the Sluice Deformation Based on SOA-LSTM-Weighted Markov Model}},
  booktitle = {Water},
  year = {2023},
  doi = {10.3390/w15213724},
}
Figure