A Remaining Useful Life Prognosis of Turbofan Engine Using Temporal and Spatial Feature Fusion

Cheng Peng, Yufeng Chen, Qing Chen, Zhaohui Tang, Lingling Li, Weihua GuiSensors 2021 · DOI

TL;DR

This paper proposes a novel method for predicting the Remaining Useful Life (RUL) of turbofan engines by fusing temporal and spatial features extracted by Long Short-Term Memory (LSTM) and a specialized 1D Convolutional Neural Network (1-FCLCNN). This hybrid approach significantly improves RUL prediction accuracy compared to traditional single-model methods, offering a more robust solution for predictive maintenance.

What Problem Does This Paper Address?

Predicting the Remaining Useful Life (RUL) of critical machinery like turbofan engines is crucial for effective predictive maintenance, aiming to reduce failure rates and operational costs. Traditional methods often struggle with the complex, non-linear, and high-dimensional nature of sensor data generated by these engines. A key challenge is the difficulty in extracting and effectively fusing both the temporal (time-series) and spatial (inter-sensor relationships) characteristics of this data. Existing single neural network models often rely on single feature extraction, leading to suboptimal prediction accuracy.

Methods

The core of this paper's contribution lies in its hybrid deep learning architecture that combines two distinct neural network components:

  • Long Short-Term Memory (LSTM): Used to capture the temporal dependencies and sequential patterns within the sensor data. LSTMs are well-suited for time-series analysis, effectively handling the "memory" of past events in the data.
  • 1D Convolutional Neural Network with Full Convolutional Layer (1-FCLCNN): Employed to extract spatial features from the sensor data. The "full convolutional layer" aspect is highlighted as a way to reduce parameters and computational complexity while maintaining feature extraction capabilities.

These two networks process different aspects of the input data in parallel. The extracted temporal features from LSTM and spatial features from 1-FCLCNN are then fused. This fused feature representation is subsequently fed into a final convolutional neural network (CNN) for secondary processing, ultimately leading to the RUL prediction. The paper also emphasizes data preprocessing steps like normalization and the use of a sliding window for feature extraction.

Datasets

The study utilizes the C-MAPSS (Commercial Modular Aero-Propulsion System Simulation) dataset, a widely recognized benchmark for turbofan engine prognostics. Specifically, the FD001 and FD003 subsets of this dataset were used for training and evaluation. These subsets are described as being simulated under similar conditions, with FD001 focusing on High-Pressure Compressor (HPC) degradation, while FD003 includes both HPC and fan degradation, representing a more complex fault scenario.

Key Insights and Ideas

  • Synergistic Fusion of Temporal and Spatial Features: The paper strongly advocates for the combined extraction and fusion of temporal and spatial features. It posits that neither type of feature alone is sufficient for accurate RUL prediction in complex systems like turbofan engines.
  • 1-FCLCNN for Efficient Spatial Feature Extraction: The introduction of a specific 1D-FCLCNN architecture is presented as an efficient method for spatial feature extraction, particularly in reducing model complexity and training parameters compared to traditional CNNs with fully connected layers.
  • Piece-wise Linear RUL Target Function: To better align with the degradation process of turbofan engines, the paper adopts a piece-wise linear RUL target function. This function models an initial "critical phase" where the RUL is relatively stable, followed by a "linear degradation phase" where RUL drops linearly with time. This is a more realistic representation than a simple linear drop.
  • Data Normalization is Crucial: The authors highlight the importance of data normalization to handle varying noise levels across different sensors and datasets, ensuring data centralization and improving the model's generalization ability.

Key Results

The proposed 1-FCLCNN-LSTM model demonstrated superior performance compared to traditional single CNN models and other state-of-the-art methods on the C-MAPSS dataset.

  • Improved Accuracy: The RMSE values for the proposed model were significantly lower than those of the traditional CNN model on both FD001 and FD003 datasets. For instance, the RMSE on the FD001 training set was 41% lower, and on FD003, it was 46% lower than the CNN model.
  • Superiority over Other Methods: When compared against a range of existing RUL prediction methods (including HDNN, DCNN, LSTM-FNN, Autoencoder-BLSTM, VAE-D2GAN, etc.), the 1-FCLCNN-LSTM model consistently achieved lower RMSE and score values on both FD001 and FD003 datasets. For example, on FD001, the RMSE was 11.17, and on FD003, it was 9.99.
  • Effectiveness in Complex Fault Scenarios: The model's performance advantage was particularly notable on the FD003 dataset, which involves two fault modes (HPC and fan degradation), suggesting its robustness in handling more complex failure scenarios.

Limitations and Future Work

  • Online Application and Incremental Updates: The authors acknowledge that a key challenge for future research is to improve the approach for online applications, specifically focusing on how to incrementally update prognosis results as new data becomes available.
  • Generalizability to Other Systems: While the model shows promise for turbofan engines, the paper suggests exploring its application to other real-world applications and large machinery systems.
  • Data Specificity: The current study is based on specific C-MAPSS datasets. Further research could investigate the model's performance on datasets with different characteristics or from different types of machinery.

Summary updated

Abstract

The prognosis of the remaining useful life (RUL) of turbofan engine provides an important basis for predictive maintenance and remanufacturing, and plays a major role in reducing failure rate and maintenance costs. The main problem of traditional methods based on the single neural network of shallow machine learning is the RUL prognosis based on single feature extraction, and the prediction accuracy is generally not high, a method for predicting RUL based on the combination of one-dimensional convolutional neural networks with full convolutional layer (1-FCLCNN) and long short-term memory (LSTM) is proposed. In this method, LSTM and 1- FCLCNN are adopted to extract temporal and spatial features of FD001 andFD003 datasets generated by turbofan engine respectively. The fusion of these two kinds of features is for the input of the next convolutional neural networks (CNN) to obtain the target RUL. Compared with the currently popular RUL prediction models, the results show that the model proposed has higher prediction accuracy than other models in RUL prediction. The final evaluation index also shows the effectiveness and superiority of the model.
BibTeX
@inproceedings{peng2021remaining,
  author = {Cheng Peng and Yufeng Chen and Qing Chen and Zhaohui Tang and Lingling Li and Weihua Gui},
  title = {{A Remaining Useful Life Prognosis of Turbofan Engine Using Temporal and Spatial Feature Fusion}},
  booktitle = {Sensors},
  year = {2021},
  doi = {10.3390/s21020418},
}
Figure