Intelligent Fault Diagnosis Method through ACCC-Based Improved Convolutional Neural Network

Chao Zhang, Qixuan Huang, Ke YangActuators 2023 · DOI

TL;DR

This paper introduces an Improved Convolutional Neural Network (ICNN) for fault diagnosis, specifically designed to handle noisy industrial signals. By incorporating dilated convolutions and a novel attention mechanism (ACCC), the ICNN effectively preserves temporal signal information and selectively amplifies important features while suppressing noise, leading to significantly improved accuracy in fault detection.

What Problem Does This Paper Address?

Accurate and reliable fault diagnosis is crucial for the safety and efficiency of complex industrial equipment. While Convolutional Neural Networks (CNNs) have shown promise in this area due to their feature extraction capabilities, traditional CNN architectures often struggle with real-world industrial data. This data is frequently corrupted by strong, non-stationary noise, which can obscure critical temporal relationships within the signals. Standard CNNs, particularly their use of pooling layers, can inadvertently discard this vital temporal information. Furthermore, without an explicit mechanism to focus on relevant features, these models can be overwhelmed by noise, hindering their ability to diagnose subtle or early-stage faults. This paper aims to bridge this gap by proposing a CNN architecture that is more robust to noise and better at capturing the nuanced temporal dynamics of fault signals.

Methods

The authors propose an Improved Convolutional Neural Network (ICNN) with three key innovations:

  • Receptive Field Guidance: The network architecture is designed such that the receptive field of the final layer closely matches the length of the original input signal. This ensures that the network learns from the complete signal sample, preserving its full temporal context.
  • Dilated Convolution: Instead of standard convolutions, the ICNN utilizes dilated convolutions. This technique introduces gaps between kernel elements, allowing for a larger receptive field without increasing the number of parameters or losing resolution. This is crucial for capturing broader patterns in noisy signals while maintaining the integrity of the signal's internal structure and temporal relationships.
  • Advanced Convolution and Channel Calibration (ACCC) Block: This novel attention mechanism is integrated into the network. The ACCC block first uses global average pooling to compress channel information into a descriptor. Then, it employs a gating mechanism with two fully-connected layers to learn channel dependencies, selectively enhancing important features and suppressing irrelevant or noisy ones. This effectively calibrates the feature channels, giving more weight to informative features.

Datasets

The proposed ICNN was validated on two datasets:

  • CWRU Bearing Dataset: This is a widely used benchmark dataset for bearing fault diagnosis, containing vibration signals from normal and various faulty bearing conditions (ball fault, inner race fault, outer race fault) under different loads.
  • NASA Bearing Dataset: This dataset was used to further evaluate the method's performance, specifically for distinguishing between different life-cycle stages of bearings (health, slight degradation, severe degradation).

Key Insights and Ideas

  • Pooling Layers are Detrimental to Temporal Information: The paper highlights that traditional pooling layers in CNNs can destroy crucial temporal information in time-series signals, leading to misinterpretations of fault conditions.
  • Dilated Convolutions Preserve Signal Structure: By using dilated convolutions, the network can achieve a larger receptive field to capture more context without the loss of temporal resolution that pooling introduces.
  • Attention is Key for Noise Robustness: The ACCC block's ability to selectively amplify important features and suppress noise is critical for achieving high accuracy in noisy environments. This suggests that attention mechanisms are not just for improving performance but for making models truly robust.
  • End-to-End Learning for Fault Diagnosis: The ICNN demonstrates the power of end-to-end learning, where raw sensor data is directly fed into the network, eliminating the need for manual feature engineering.

Key Results

The ICNN demonstrated superior performance compared to traditional methods and other CNN architectures on both datasets:

  • CWRU Bearing Dataset: The proposed method achieved the highest average accuracy, reaching 97.11% with a standard deviation of 0.84%. This is a significant improvement over traditional CNNs (93.16%), 1D-DCNN (95.69%), and 1D-SECNN (96.49%).
  • NASA Bearing Dataset: The ICNN achieved an average testing accuracy of 90.26% with a standard deviation of 1.36%, outperforming other methods in distinguishing bearing life-cycle stages.
  • Noise Robustness: The ICNN showed strong performance even in high-noise environments (low SNR), achieving an average accuracy of 94.78%, which was higher than other methods at low SNRs.

Limitations and Future Work

  • Training Time: While the ICNN achieves higher accuracy, it does involve a slight increase in training time compared to some simpler CNN architectures, particularly when the ACCC block is introduced. The authors suggest this is a worthwhile trade-off for improved accuracy.
  • Generalizability to Other Domains: While tested on bearing data and mentioned for voice calls, further validation across a wider range of industrial applications and signal types would be beneficial.
  • Interpretability: While the attention mechanism offers some insight into feature importance, further research into making the ICNN's decision-making process more interpretable could be valuable for industrial deployment.

Summary updated

Abstract

Fault diagnosis plays an important role in improving the safety and reliability of complex equipment. Convolutional neural networks (CNN) have been widely used to diagnose faults due to their powerful feature extraction and learning capabilities. In practical industrial applications, the obtained signals always are disturbed by strong and highly non-stationary noise, so the timing relationships of the signals should be highlighted more. However, most CNN-based fault diagnosis methods directly use a pooling layer, which may corrupt the timing relationship of the signals easily. More importantly, due to a lack of an attention mechanism, it is difficult to extract deep informative features from noisy signals. To solve the shortcomings, an intelligent fault diagnosis method is proposed in this paper by using an improved convolutional neural network (ICNN) model. Three innovations are developed. Firstly, the receptive field is used as a guideline to design diagnosis network structures, and the receptive field of the last layer is close to the length of the original signal, which can enable the network to fully learn each sample. Secondly, the dilated convolution is adopted instead of standard convolution to obtain larger-scale information and preserves the internal structure and temporal relation of the signal when performing down-sampling. Thirdly, an attention mechanism block named advanced convolution and channel calibration (ACCC) is presented to calibrate the feature channels, thus the deep informative features are distributed in larger weights while noise-related features are effectively suppressed. Finally, two experiments show the ICNN-based fault diagnosis method can not only process strong noise signals but also diagnose early and minor faults. Compared with other methods, it achieves the highest average accuracy at 94.78% and 90.26%, which are 6.53% and 7.70% higher than the CNN methods, respectively. In complex machine bearing failure conditions, this method can be used to better diagnose the type of failure; in voice calls, this method can be used to better distinguish between voice and noisy background sounds to improve call quality.
BibTeX
@inproceedings{zhang2023intelligent,
  author = {Chao Zhang and Qixuan Huang and Ke Yang and Chaoyi Zhang and Chaoyi Zhang and Chaoyi Zhang},
  title = {{Intelligent Fault Diagnosis Method through ACCC-Based Improved Convolutional Neural Network}},
  booktitle = {Actuators},
  year = {2023},
  doi = {10.3390/act12040154},
}
Figure