Deformation Detection Method for Substation Noise Barrier Column Based on Deep Learning and Digital Image Technology

Fei-En Wu, Makara Mao, Sheng Hu, Xiaomin Dai, Qiang He, Jinhui Tang, Xian HongProcesses 2025 · DOI

TL;DR

This paper introduces a novel method for detecting structural deformation in substation noise barrier columns by combining Digital Image Correlation (DIC) with Convolutional Neural Networks (CNNs). This approach offers a non-contact, highly accurate, and efficient solution for structural health monitoring, significantly improving upon traditional sensor-based methods and overcoming limitations of existing DIC techniques.

What Problem Does This Paper Address?

Substation noise barrier columns are critical structural components that experience significant deformation and stress, especially under wind loads. Monitoring their health is crucial for preventing failures and ensuring safety. Traditional methods using physical sensors are often cumbersome, requiring extensive wiring and data acquisition equipment, and can be unreliable due to environmental factors and wear. While Digital Image Correlation (DIC) offers a non-contact alternative with high precision, its application in engineering is limited by processor performance and image resolution. This paper aims to bridge this gap by developing a more efficient and robust method for structural displacement identification using deep learning.

Methods

The core of this research lies in the integration of DIC and CNNs. First, DIC technology is employed to capture and analyze images of the noise barrier column under static loading, generating displacement cloud maps. These displacement maps, along with the original images, form the dataset. To enhance the data, normalization and region division techniques are applied.

A Convolutional Neural Network (CNN) is then designed and trained to identify displacement differences between images. The paper explores various CNN architectures (LeNet, AlexNet, VGG16, VGG19, GoogLeNet) to determine the optimal number of layers. Hyperparameters like learning rate and activation functions (Leaky ReLU was found to be optimal) are also tuned. The trained CNN model then processes new image data to predict displacement, which is then compared against DIC results for validation.

Datasets

The dataset for training and evaluation was generated from a static loading test of an equal-scale sound barrier. High-speed camera images were captured during the loading process. The displacement cloud maps obtained from DIC analysis of these images served as the ground truth (labels) for training the CNN. The paper mentions using 500 images in the test set.

Key Insights and Ideas

  • Synergistic Power of DIC and CNNs: The combination of DIC's precise displacement measurement capabilities with CNN's powerful feature extraction and pattern recognition abilities creates a robust system for structural deformation monitoring.
  • Overcoming DIC Limitations: By using CNNs, the paper addresses the computational bottlenecks and resolution limitations that previously hindered the widespread application of DIC in complex engineering scenarios.
  • Data Augmentation is Key: Techniques like data normalization and region division are crucial for enhancing the dataset, improving the stability and robustness of the deep learning model, especially when dealing with varying environmental conditions.
  • CNNs Learn Displacement Patterns: The CNN effectively learns to identify subtle displacement changes from image pairs, demonstrating its ability to capture deformation modes comparable to DIC.

Key Results

The proposed CNN-DIC method demonstrated accurate identification of structural displacement changes. The efficiency of image displacement calculation using DIC technology was significantly improved. The error between the CNN-identified displacement and DIC results was controlled within 5%. The GoogLeNet model was identified as the most suitable network architecture, and Leaky ReLU was the optimal activation function.

Limitations and Future Work

The paper acknowledges that in extreme environments, image quality can be affected by factors like low temperatures, high humidity, and varying illumination, potentially impacting the accuracy of the system. Future work could involve:

  • Real-time Preprocessing and Fault Tolerance: Integrating real-time detection and preprocessing of input data, along with fault-tolerant mechanisms for equipment, to ensure stable operation under extreme conditions.
  • Multi-scale Modeling for Complex Geometries: For large structures or complex geometries, a multi-scale approach dividing the structure into subregions processed by local CNN models, followed by global fusion, could be beneficial.
  • Image Enhancement Techniques: Combining image enhancement techniques (contrast adjustment, denoising) and self-supervised learning to improve image quality and model robustness.
  • Multi-modal Data Fusion: Integrating data from other sensors (lidar, infrared, acoustic) to provide supplementary information and reduce instability caused by poor image quality.
  • Adaptive Learning: Developing adaptive learning algorithms to continuously adjust the model for changing field conditions and image quality.
  • High-Resolution Monitoring: Recommending the use of high-resolution industrial cameras for tasks requiring precise monitoring of small deformations or cracks.
  • Edge Computing: Utilizing edge computing hardware for faster image processing and analysis, especially for large-scale monitoring.
  • Data Augmentation for Training: Emphasizing the need for diverse training datasets and suggesting image processing techniques to increase input image diversity for better CNN training.

Summary updated

Abstract

The dynamic identification of the deformation of a noise barrier column is of great significance to the monitoring of its health. At the same time, the maximum stress of the column is an important indicator for the evaluation of its health status. Traditional contact displacement monitoring installs sensors on the structure, requires a lot of wiring and data acquisition equipment, and establishes a relatively independent and stable displacement reference system. Affected by the environment, wear, and material aging, the efficiency and reliability of data acquisition are reduced. A monitoring method based on digital image has the advantages of non-contact monitoring, high precision, and strong reliability. The existing DIC detection methods are limited by processor performance and image resolution, which are difficult to apply to engineering detection. In this paper, a structural displacement identification method based on convolutional neural networks (CNNs) and DIC technology is proposed. In this method, the data set is formed according to the column displacement cloud image obtained by DIC analysis, and the data set is enhanced by data normalization and region division. Through the analysis of the number of network layers and learning rate, the model design of the deep learning network is carried out. The high-speed camera image results of the test are introduced and identified by the static loading test of the equal-scale sound barrier. The results show that the structural displacement identification method based on CNN and DIC technology can accurately identify the displacement change in the structure, which greatly improves the efficiency of image displacement calculation using DIC technology.
BibTeX
@inproceedings{wu2025deformation,
  author = {Fei-En Wu and Makara Mao and Sheng Hu and Xiaomin Dai and Qiang He and Jinhui Tang and Xian Hong},
  title = {{Deformation Detection Method for Substation Noise Barrier Column Based on Deep Learning and Digital Image Technology}},
  booktitle = {Processes},
  year = {2025},
  doi = {10.3390/pr13010215},
}
Figure