An Intelligent Machinery Fault Diagnosis Method Based on GAN and Transfer Learning under Variable Working Conditions

Wangpeng He, Jing Chen, Yue Zhou, Xuan Liu, Binqiang Chen, Baolong GuoSensors 2022 · DOI

TL;DR

This paper introduces a novel approach for intelligent machinery fault diagnosis that tackles the challenge of insufficient and variably distributed data across different operating conditions. By combining Generative Adversarial Networks (GANs) for data augmentation and Transfer Learning with a deep residual network, the method effectively adapts diagnostic models to new environments, significantly improving accuracy.

What Problem Does This Paper Address?

Traditional machine learning models for fault diagnosis in mechanical equipment often assume abundant, consistently distributed, and labeled data. However, in real-world scenarios, obtaining such data is difficult and expensive. Mechanical equipment operates under varying conditions (e.g., load, speed), leading to shifts in data distribution that degrade the performance of models trained on one set of conditions when applied to another. This "cross-condition" problem, coupled with limited fault data, hinders the widespread adoption of intelligent fault diagnosis. The paper aims to bridge this gap by developing a method that can learn from limited data and generalize well across different working environments.

Methods

The proposed method integrates three key components:

  1. Target Domain Data Enhancement (GAN): A Deep Convolutional Generative Adversarial Network (DCGAN) is employed to generate synthetic "dummy" samples that mimic the characteristics of the target domain's fault data. This addresses the scarcity of labeled data by expanding the training set.
  2. Transfer Fault Feature Extraction (ResNet-50): A pre-trained ResNet-50 model is used as a deep feature extractor. It processes both source and target domain data to capture relevant fault characteristics. ResNet-50 is chosen for its strong feature expression and generalization capabilities, and its residual structure helps mitigate gradient vanishing issues in deep networks.
  3. Domain Adaptation Regularization (MMD): To reduce the distribution shift between the source and target domains, a domain adaptation regularization term based on Maximum Mean Discrepancy (MMD) is incorporated into the training process of the ResNet-50. MMD quantifies the difference between the feature distributions of the two domains, and minimizing it helps align them.

The overall process involves converting 1D vibration signals into 2D spectrograms, using DCGAN to augment the target domain data, extracting features with ResNet-50, and then training a transfer fault diagnosis model by minimizing a combined loss function (cross-entropy for source domain and MMD for domain adaptation).

Datasets

The proposed method was validated using two publicly available bearing fault datasets:

  • Case Western Reserve University (CWRU) Dataset: This dataset contains vibration signals from a bearing test rig under four different load conditions (domains A, B, C, D). Each domain includes data for normal operation and nine fault states (inner race, outer race, roller faults) at various damage sizes.
  • Paderborn University (PU) Dataset: This dataset features vibration data from a test bench under three different working conditions (domains A, B, C). It includes normal operation and eight fault states with varying damage modes, degrees, and locations.

Key Insights and Ideas

  • GANs as a powerful data augmentation tool: The paper demonstrates that GANs can effectively generate realistic synthetic fault data, significantly expanding limited datasets and improving model robustness.
  • The critical role of domain adaptation: Simply using a powerful feature extractor like ResNet-50 is insufficient for cross-condition diagnosis. Explicitly minimizing domain distribution differences (via MMD) is crucial for successful knowledge transfer.
  • ResNet-50's suitability for feature extraction: The choice of ResNet-50 highlights its effectiveness in capturing complex fault features, which then benefit from domain adaptation.
  • Visualizing feature spaces reveals model performance: t-SNE visualizations clearly show how the proposed method leads to better-separated and clustered feature representations compared to baseline methods.

Key Results

The proposed method achieved state-of-the-art performance across multiple transfer tasks on both the CWRU and PU datasets.

  • CWRU Dataset: The average diagnosis accuracy across 12 transfer tasks reached 98.5%, significantly outperforming CNN (76.8%), CNN+MMD (82.3%), and ResNet-50 (89.3%).
  • PU Dataset: The proposed method achieved an average accuracy of 94.1% across six transfer tasks, also surpassing CNN (79.8%), CNN+MMD (84.3%), and ResNet-50 (88.7%).
  • Qualitative Results: Confusion matrices and t-SNE visualizations confirmed that the proposed method effectively reduces misclassifications, especially for faults with similar characteristics but different sizes or types, and produces well-clustered feature representations.

Limitations and Future Work

  • Singular metric for domain difference: The paper acknowledges that MMD is a single metric for measuring distribution differences, and future work could explore a variety of metrics for more comprehensive quantification.
  • Computational efficiency: The authors suggest simplifying the network models to improve computational efficiency.
  • Noisy data: The paper notes that handling noisy data is a challenge, and future research could investigate combining sparsity-based denoising techniques with their proposed fault diagnosis model.

Summary updated

Abstract

Intelligent fault diagnosis is of great significance to guarantee the safe operation of mechanical equipment. However, the widely used diagnosis models rely on sufficient independent and homogeneously distributed monitoring data to train the model. In practice, the available data of mechanical equipment faults are insufficient and the data distribution varies greatly under different working conditions, which leads to the low accuracy of the trained diagnostic model and restricts it, making it difficult to apply to other working conditions. To address these problems, a novel fault diagnosis method combining a generative adversarial network and transfer learning is proposed in this paper. Dummy samples with similar fault characteristics to the actual engineering monitoring data are generated by the generative adversarial network to expand the dataset. The transfer fault characteristics of monitoring data under different working conditions are extracted by a deep residual network. Domain-adapted regular term constraints are formulated to the training process of the deep residual network to form a deep transfer fault diagnosis model. The bearing fault data are used as the original dataset to validate the effectiveness of the proposed method. The experimental results show that the proposed method can reduce the influence of insufficient original monitoring data and enable the migration of fault diagnosis knowledge under different working conditions.
BibTeX
@inproceedings{he2022intelligent,
  author = {Wangpeng He and Jing Chen and Yue Zhou and Xuan Liu and Binqiang Chen and Baolong Guo},
  title = {{An Intelligent Machinery Fault Diagnosis Method Based on GAN and Transfer Learning under Variable Working Conditions}},
  booktitle = {Sensors},
  year = {2022},
  doi = {10.3390/s22239175},
}
Figure