A Transfer Learning Framework with a One-Dimensional Deep Subdomain Adaptation Network for Bearing Fault Diagnosis under Different Working Conditions

Ruixin Zhang, Yu GuSensors 2022 · DOI

TL;DR

This paper introduces a novel "one-dimensional lightweight deep subdomain adaptation network" (1D-LDSAN) for more accurate and faster bearing fault diagnosis, even when operating conditions change. By using a specialized deep learning architecture and a domain adaptation technique called Local Maximum Mean Discrepancy (LMMD), the model effectively learns from data collected under one set of conditions and applies it to data from different conditions, achieving high accuracy.

What Problem Does This Paper Address?

Rotating machinery, like those found in power generation, chemical production, and aerospace, relies heavily on rolling bearings. These bearings are critical components, and their failure can lead to significant damage and downtime. Accurate and rapid fault diagnosis is essential for maintaining operational efficiency. While deep learning (DL) methods have shown great promise in this area, their performance often degrades significantly when the operating conditions (e.g., load, speed, temperature) of the machinery change between training and testing. This is because the data distribution shifts, making it difficult for models trained on one set of conditions to generalize to another. This paper tackles this "domain shift" problem, aiming to develop a robust fault diagnosis system that works reliably across different working conditions without requiring extensive retraining.

Methods

The core of the proposed solution is the 1D-LDSAN framework, which combines a feature extraction module with a classification and adaptation module.

  • Feature Extraction: A lightweight one-dimensional convolutional neural network (1D-CNN) backbone is employed. This CNN is designed to efficiently extract comprehensive and significant features from raw vibration signals. It incorporates elements inspired by MobileNetV2, utilizing separable and inverted bottleneck blocks to reduce computational complexity while maintaining strong feature representation.
  • Domain Adaptation: To bridge the gap between different working conditions (domains), the paper uses Local Maximum Mean Discrepancy (LMMD). Unlike standard Maximum Mean Discrepancy (MMD) which aligns global distributions, LMMD focuses on matching local probability distributions within subdomains. This is crucial for capturing fine-grained information that might be lost if only global distributions are considered, leading to better performance when working conditions change significantly.
  • Classification: A fully connected (FC) neural network acts as the classifier, taking the extracted features and using them to predict the fault class. The weights of this classifier are shared between source and target domains.

The framework is trained by minimizing two objectives: a cross-entropy loss for accurate classification on the source domain and the LMMD loss to minimize the distribution discrepancy between the source and target domains. An Adam optimizer and an exponential learning rate decay strategy are used for training.

Datasets

The primary dataset used for training and evaluation is the Case Western Reserve University (CWRU) bearing dataset. This dataset is a standard benchmark for bearing fault diagnosis and contains vibration data collected under various operating conditions (0, 1, 2, and 3 HP loads) and with different fault types (inner race, outer race, and roller faults) and damage sizes. The paper divides this dataset into four domains (A, B, C, D) to simulate different working conditions, creating 12 transfer learning tasks (e.g., A to B, B to A, etc.).

Key Insights and Ideas

  • Subdomain Adaptation is Key: The paper highlights that simply aligning global distributions between domains isn't enough. Matching local subdomain distributions (using LMMD) is critical for accurately diagnosing faults when working conditions change, especially for subtle fault types.
  • Lightweight Architecture Matters: Using a lightweight CNN backbone (inspired by MobileNetV2) allows for faster feature extraction without sacrificing diagnostic accuracy, which is important for real-time applications.
  • Effective Generalization with Limited Target Data: The proposed 1D-LDSAN demonstrates impressive performance even when trained with only a small proportion (as low as 10%) of unlabeled target domain data, showcasing its strong generalization capabilities.
  • Signal Length Optimization: The study systematically investigates the impact of signal length on performance, finding that a length of 1024 data points provides the optimal balance for their framework on the CWRU dataset.

Key Results

  • The proposed 1D-LDSAN achieved an average classification accuracy of 99.82% across 12 transfer learning tasks on the CWRU dataset, outperforming five other state-of-the-art methods, including 1D-CNN, DDC, DANN, RJANN, and WDMAN.
  • For the challenging transfer task A-D (significant condition change), the 1D-LDSAN achieved 100% accuracy in most cases, whereas other methods showed considerable performance drops.
  • When using only 10% of the unlabeled target domain data for training, the 1D-LDSAN still achieved over 98% accuracy on average across the 12 transfer tasks.
  • The parameter sensitivity analysis indicated that the initial learning rate has a marked influence on performance, while the trade-off parameter $\lambda$ and the kernel size of the first convolution layer have a relatively smaller impact.

Limitations and Future Work

  • Dataset Specificity: While the CWRU dataset is a standard benchmark, the framework's performance on other, more complex or diverse datasets with different noise characteristics or fault types is not explored.
  • Computational Cost: Although the architecture is described as "lightweight," the paper doesn't provide explicit comparisons of computational cost (e.g., training time, inference time) against all baseline methods.
  • Future Work: The authors suggest focusing on more effective deep domain adaptation methods in future research. They also aim to further explore the framework's potential for fault diagnosis under even more challenging conditions.

Summary updated

Abstract

Accurate and fast rolling bearing fault diagnosis is required for the normal operation of rotating machinery and equipment. Although deep learning methods have achieved excellent results for rolling bearing fault diagnosis, the performance of most methods declines sharply when the working conditions change. To address this issue, we propose a one-dimensional lightweight deep subdomain adaptation network (1D-LDSAN) for faster and more accurate rolling bearing fault diagnosis. The framework uses a one-dimensional lightweight convolutional neural network backbone for the rapid extraction of advanced features from raw vibration signals. The local maximum mean discrepancy (LMMD) is employed to match the probability distribution between the source domain and the target domain data, and a fully connected neural network is used to identify the fault classes. Bearing data from the Case Western Reserve University (CWRU) datasets were used to validate the performance of the proposed framework under different working conditions. The experimental results show that the classification accuracy for 12 tasks was higher for the 1D-LDSAN than for mainstream transfer learning methods. Moreover, the proposed framework provides satisfactory results when a small proportion of the unlabeled target domain data is used for training.
BibTeX
@inproceedings{zhang2022transfer,
  author = {Ruixin Zhang and Yu Gu},
  title = {{A Transfer Learning Framework with a One-Dimensional Deep Subdomain Adaptation Network for Bearing Fault Diagnosis under Different Working Conditions}},
  booktitle = {Sensors},
  year = {2022},
  doi = {10.3390/s22041624},
}
Figure