Feature learning for fault detection in high-dimensional condition monitoring signals

Gabriel Michau, Yang Hu, Thomas Palmé, Olga Fink

TL;DR

This paper introduces Hierarchical Extreme Learning Machines (HELM) for fault detection in industrial systems. HELM combines unsupervised feature learning with a one-class classifier, trained only on healthy data, to detect anomalies. It demonstrates superior performance and robustness compared to other methods, especially in complex, high-dimensional scenarios with limited fault data.

What Problem Does This Paper Address?

Modern industrial systems generate vast amounts of sensor data, making it challenging to monitor their health and detect faults. The sheer diversity of operating conditions and potential fault types means it's often impossible to collect sufficient data for all possible fault scenarios. Traditional methods often rely on manually engineered features, which is time-consuming, expert-dependent, and struggles with the increasing complexity and dimensionality of sensor data. Furthermore, supervised learning approaches require labeled fault data, which is scarce. This paper tackles the problem of fault detection in high-dimensional, condition-monitoring signals when only healthy data is available for training.

Methods

The core of the proposed solution is the Hierarchical Extreme Learning Machine (HELM). HELM is built upon stacked Extreme Learning Machines (ELMs). The architecture consists of:

  • Autoencoder (AE) for Unsupervised Feature Learning: The initial layers are autoencoders. These are trained to reconstruct their input, learning to extract meaningful, lower-dimensional representations (features) from the raw sensor data without needing any fault labels. This is a form of representation learning.
  • One-Class Classifier (OCC) for Anomaly Detection: The final layer is a one-class classifier (also an ELM). This classifier takes the learned features from the autoencoder as input and is trained to distinguish the "healthy" class from any deviations. It essentially learns a decision boundary around the normal operating conditions.
  • Health Indicator: The output of the OCC is interpreted as a "health indicator." A higher output value signifies a greater deviation from the healthy state, thus indicating a potential fault.
  • Thresholding: A threshold is established using a separate set of healthy data (not used for training) to define what constitutes an anomaly.

The training process is sequential and independent for each layer, avoiding the complexities of backpropagation in deep networks.

Datasets

The paper evaluates the proposed HELM approach on two types of datasets:

  • Synthetic Dataset: A simulated dataset was generated to represent typical condition-monitoring signals. This dataset allowed for controlled experiments and evaluation across various fault types and system complexities (varying number of sensors and signal types).
  • Real-World Dataset: Data from an H2-cooled generator in a power plant was used. This dataset covered nine months of operation with 310 sensors and captured a specific generator fault scenario.

Key Insights and Ideas

  • Leveraging Healthy Data Alone: The most significant insight is the ability to achieve effective fault detection using only healthy data for training. This bypasses the common bottleneck of needing extensive labeled fault data.
  • Feature Learning is Crucial: The paper strongly emphasizes that feature learning (via autoencoders) is essential for improving the performance of one-class classifiers, especially in high-dimensional spaces where raw data can be noisy or contain non-informative signals.
  • HELM's Robustness: HELM demonstrated consistent and robust performance across different fault types and system complexities, outperforming other methods, particularly when dealing with non-linear relationships in the data.
  • Interpretable Health Indicator: The output of the one-class classifier acts as a continuous health indicator, providing more nuanced information than a simple binary fault/no-fault classification. This allows for tracking the evolution of system health.
  • Efficiency: HELM is significantly faster to train and run compared to some other deep learning approaches like Deep Belief Networks (DBNs) and traditional methods like SVMs.

Key Results

  • Simulated Case Study: HELM achieved consistently high accuracies (around 95%) across various fault types and system configurations (n=5 and n=10 base signals). It outperformed standalone ELM, SVM, PCA-enhanced ELM/SVM, and DBNs. HELM also showed a strong magnification coefficient, indicating high confidence in its detections.
  • Real-World Case Study (Generator Fault): HELM achieved the highest accuracy (95%) with zero false positives (FP) and a good magnification coefficient (20). This was significantly better than other methods, including SVM, which, while having zero FP, had lower accuracy and a much smaller magnification. HELM was also considerably faster to train (0.5s vs. 169s for SVM).
  • Early Fault Detection: In the real-world case, HELM was able to detect the fault at its earliest stage, even before human experts identified it, demonstrating its potential for proactive maintenance.

Limitations and Future Work

  • Hyperparameter Tuning: The paper acknowledges that "a priori hyperparameter setting remains open." While the study optimized hyperparameters a posteriori, future work could focus on developing methods for setting these parameters without prior knowledge of fault conditions.
  • Number of Autoencoder Layers: The current HELM architecture uses a single feature learning layer. The paper suggests that additional feature learning layers might be necessary for datasets with even higher dimensionality.
  • Synthetic Data Generation: While the synthetic dataset aimed to mimic real-world characteristics, it's a simplification. Further validation on a wider range of real-world industrial datasets would be beneficial.

Summary updated

Abstract

Complex industrial systems are continuously monitored by a large number of heterogeneous sensors. The diversity of their operating conditions and the possible fault types make it impossible to collect enough data for learning all the possible fault patterns. This article proposes an integrated automatic unsupervised feature learning and one-class classification for fault detection that uses data on healthy conditions only for its training. The approach is based on stacked extreme learning machines (namely hierarchical extreme learning machines) and comprises an autoencoder, performing unsupervised feature learning, stacked with a one-class classifier monitoring the distance of the test data to the training healthy class, thereby assessing the health of the system. This study provides a comprehensive evaluation of hierarchical extreme learning machines fault detection capability compared to other machine learning approaches, such as stand-alone one-class classifiers (extreme learning machines and support vector machines); these same one-class classifiers combined with traditional dimensionality reduction methods (principal component analysis) and a deep belief network. The performance is first evaluated on a synthetic dataset that encompasses typical characteristics of condition monitoring data. Subsequently, the approach is evaluated on a real case study of a power plant fault. The proposed algorithm for fault detection, combining feature learning with the one-class classifier, demonstrates a better performance, particularly in cases where condition monitoring data contain several non-informative signals.
BibTeX
@article{michau2019feature,
  author = {Gabriel Michau and Yang Hu and Thomas Palmé and Olga Fink},
  title = {{Feature learning for fault detection in high-dimensional condition monitoring signals}},
  journal = {Proceedings of the Institution of Mechanical Engineers Part O Journal of Risk and Reliability},
  year = {2019},
  doi = {10.1177/1748006x19868335},
}
Figure