A Deep Transfer Learning Network for Structural Condition Identification with Limited Real-World Training Data

Nengxin Bao, Tong Zhang, Ruizhi Huang, S. Biswal, Jingyong Su, Ying Wang

TL;DR

This paper introduces TL-SHMnet, a deep transfer learning framework that solves the "data drought" in structural health monitoring. by pretraining a neural network on physics-based simulations (Finite Element models) and fine-tuning it with minimal real-world data, the researchers achieved high-accuracy damage identification in steel structures, even when the training and testing data came from entirely different domains.

What Problem Does This Paper Address?

Structural Health Monitoring (SHM) is the "check-engine light" for civil infrastructure like bridges and buildings. While deep learning (DL) has shown great promise in identifying structural damage, it faces a massive hurdle: data scarcity.

In the real world, we rarely have labeled data for every possible way a building might fail. Experiments are expensive and time-consuming, and real-time monitoring usually only captures a structure in its healthy state. When a DL model is trained on limited data, its performance tanks when faced with a slightly different damage scenario. The authors tackle this by asking: Can we use physics-based simulations to teach a model the "rules" of structural behavior, then transfer that knowledge to real-world sensors?

Methods

The authors propose a three-step transfer learning (TL) workflow:

  1. Physics-Based Data Generation: They create and calibrate a high-fidelity Finite Element (FE) model of a steel frame. This model acts as a "synthetic laboratory," generating thousands of vibration responses for various damage scenarios (e.g., loose bolts).
  2. Pretraining (The Source Domain): They use a 1D Convolutional Neural Network (CNN) called SHMnet. Unlike standard image-based CNNs, this processes raw acceleration time-history data directly. The network is trained on the massive synthetic dataset to learn the intrinsic physics of how damage affects vibrations.
  3. Knowledge Transfer (The Target Domain): The pretrained model is then "fine-tuned" using a tiny amount of real-world experimental data. The authors tested three strategies:
  4. Strategy 1: Freeze the convolutional (feature extraction) layers and only train the fully connected (classification) layers.
  5. Strategy 2: Freeze only part of the classification layers.
  6. Strategy 3: Fine-tune the entire network.

Datasets

The study utilized two primary data sources:

  • Experimental Data: Collected from a single-bay, single-storey steel frame in a laboratory. It included 10 damage scenarios involving loosened bolts at different locations and one "intact" scenario.
  • Synthetic Data: Generated via a calibrated FE model. This included 36 simulated damage scenarios, varying the stiffness of different joints to mimic bolt loosening.
  • Benchmarks: The authors compared their SHMnet architecture against industry standards VGG-16 and ResNet-18 to evaluate performance on 1D vibration data.

Key Insights and Ideas

  • Simpler is Sometimes Better: Surprisingly, the custom SHMnet (with only three convolutional layers) significantly outperformed much deeper architectures like ResNet-18. The authors suggest that for small real-world datasets, overly complex models are prone to overfitting, while the shallower SHMnet captures the essential features without getting lost in the noise.
  • The "Physics" is in the Features: The most successful transfer strategy was freezing the convolutional layers. This implies that the "low-level" features learned from simulation—how a wave decays or shifts in frequency—are universal enough to apply to real-world structures, even if the exact signal distributions differ.
  • Bridging the Domain Gap: The study proves that even if simulation labels and real-world labels don't match perfectly, the model can learn "intrinsic physics" during pretraining that makes it much more robust when it finally sees real steel and sensors.

Key Results

  • Accuracy Boost: In the numerical-to-experimental transfer task, the identification accuracy jumped from 81.8% (without transfer) to 89.1% (with transfer).
  • Generalization: In cases where the training data was missing specific damage types, transfer learning improved accuracy by up to 8.57%.
  • Architecture Comparison: SHMnet achieved 21.8% and 25.5% higher accuracy than VGGnet-16 and ResNet-18, respectively, when using the same transfer strategy.
  • Efficiency: Once trained, the model can deliver identification results in under 1 second, making it viable for real-time monitoring.

Limitations and Future Work

While successful, the approach relies heavily on the quality of the FE model. If the simulation is too far removed from reality, "negative transfer" could occur, where the synthetic data actually confuses the model.

The authors suggest two main paths forward:

  1. Generative AI: Using Generative Adversarial Networks (GANs) to further enrich training datasets by creating even more realistic synthetic signals.
  2. Scaling Up: Testing the framework on complex, large-scale structures like urban bridges, where environmental noise and random vehicle loads make damage detection much harder than in a controlled lab setting.

Summary updated

Abstract

Structural condition identification based on monitoring data is important for automatic civil infrastructure asset management. Nevertheless, the monitoring data are almost always insufficient because the real-time monitoring data of a structure only reflect a limited number of structural conditions, while the number of possible structural conditions is infinite. With insufficient monitoring data, the identification performance may significantly degrade. This study aims to tackle this challenge by proposing a deep transfer learning (TL) approach for structural condition identification. It effectively integrates physics-based and data-driven methods by generating various training data based on the calibrated finite element (FE) model, pretraining a deep learning (DL) network, and transferring its embedded knowledge to the real monitoring/testing domain. Its performance is demonstrated in a challenging case, vibration-based condition identification of steel frame structures with bolted connection damage. First, disparate subsets of test data are used as training data, and the identification accuracy of the whole dataset is evaluated. The results demonstrate that the proposed approach can achieve high identification accuracy with limited types of training data, with the identification accuracy increasing up to 8.57%. Second, numerical simulation data are used as training data, and then different TL strategies and different DL architectures are compared on the performance of structural condition identification. The results show that even though the training data are from a different domain and with different types of labels, intrinsic physics can be learned through the pretraining process, and the TL results can be clearly improved, with the identification accuracy increasing from 81.8% to 89.1%. The comparative studies show that SHMnet with three convolutional layers stands out as the pretraining DL architecture, with 21.8% and 25.5% higher identification accuracy values over the other two networks, VGGNet-16 and ResNet-18. The findings of this study advance the potential application of the proposed approach towards expert-level condition identification based on limited real-world training data.
BibTeX
@inproceedings{bao2023deep,
  author = {Nengxin Bao and Tong Zhang and Ruizhi Huang and S. Biswal and Jingyong Su and Ying Wang},
  title = {{A Deep Transfer Learning Network for Structural Condition Identification with Limited Real-World Training Data}},
  booktitle = {Structural},
  year = {2023},
  doi = {10.1155/2023/8899806},
}

Loading related content...

Figure