Unsupervised Transfer Learning Method via Cycle-Flow Adversarial Networks for Transient Fault Detection under Various Operation Conditions

Xiaoyue Yang, Long Chen, Qidong Feng, Yucheng Yang, Sen XieSensors 2024 · DOI

TL;DR

This paper introduces a novel unsupervised transfer learning approach using Cycle-Flow Adversarial Networks (CFANs) to detect transient faults in high-speed train traction control systems (TCSs) under varying operating conditions. By leveraging knowledge from steady-state operation to adapt to dynamic scenarios, the method significantly improves fault detection accuracy and robustness, addressing the challenge of imbalanced data.

What Problem Does This Paper Address?

High-speed train traction control systems (TCSs) are critical for safety and reliability, but they are prone to transient faults (TFs). These faults are often subtle, masked by noise, and occur unpredictably, especially during dynamic operating conditions. A major challenge is the scarcity of labeled fault data across all possible operating scenarios, leading to imbalanced datasets that hinder the performance of traditional fault detection (FD) models. Existing methods often struggle to generalize to new operating conditions without extensive retraining, making them impractical for real-world applications.

Methods

The core of this work is a Cycle-Flow Adversarial Network (CFAN), which is designed for robust feature extraction and data reconstruction. A CFAN combines an invertible flow model with two discriminative networks (one for the forward process, one for the reverse). This architecture allows for bidirectional optimization, enhancing reconstruction quality and mitigating noise through adversarial training.

The proposed method then employs a federated transfer learning (TL) strategy using these CFANs. It operates in two stages:

  1. Source Domain Training: A CFAN (CFAN₁) is trained on normal data from steady-state operation conditions to learn fundamental system characteristics and reconstruct healthy data.
  2. Target Domain Adaptation: A second CFAN (CFAN₂) is trained using data from dynamic operating conditions. This CFAN adapts the knowledge learned by CFAN₁ to account for changes introduced by new operating conditions, using only a few samples. The residual signal from CFAN₁ is used as input to CFAN₂, allowing it to calibrate for domain shifts.

Finally, the fault detection decision is made by analyzing the residual signal generated by the adapted CFANs, comparing its Root Mean Square (RMS) value against a dynamically set threshold.

Datasets

The study utilizes data collected from an onboard TCS in high-speed trains. The experimental setup involved a simulation platform named "TDCS-FIB" for fault injection.

  • Source Domain Training Data (Ds): 1x10³ samples from the normal steady state of the TCS.
  • Target Domain Training Data (Dt): 2x10² samples from dynamic operating conditions and 50 samples from steady state.
  • Test Dataset: Contains four transient fault scenarios and fault-free scenarios. Each fault scenario has 5x10² samples, and the fault-free scenario has 1x10⁵ samples.

Key Insights and Ideas

  • Adversarial Training for Robustness: Using adversarial networks within the CFAN framework helps to improve the quality of data reconstruction and suppress background noise, which is crucial for detecting subtle transient faults.
  • Cycle-Flow for Reversibility and Flexibility: The invertible nature of the flow model in CFANs allows for both forward and reverse transformations, enabling a more comprehensive understanding and reconstruction of data distributions. This reversibility is key for adapting to domain shifts.
  • Federated Learning for Domain Adaptation: The two-stage federated approach effectively transfers knowledge from a well-understood source domain (steady state) to a less understood target domain (dynamic conditions) with minimal target data, overcoming the limitations of data imbalance.
  • Residual Analysis for Fault Detection: The method relies on analyzing the residual signal generated by the adapted CFANs. Significant deviations in this residual indicate a fault, providing a sensitive indicator for transient events.

Key Results

The proposed federated CFAN-based TL method demonstrated superior performance compared to traditional VAE (without TL) and a federated VAE (with TL).

  • Fault Detection Rate (FDR): The proposed method achieved an FDR of 94.3% for F1, 95.2% for F2, 100% for F3, and 92.7% for F4. These figures are consistently higher than or comparable to the federated VAE and significantly better than the traditional VAE.
  • False Alarm Rate (FAR): The proposed method achieved a FAR of 8.1%, which is notably lower than the traditional VAE (36.5%) and the federated VAE (12.3%).
  • Accuracy Rate (ACR): The proposed method achieved an ACR of 92.5%, outperforming the traditional VAE (68.1%) and the federated VAE (88.6%).
  • Average Fault Detection Delay: The proposed method achieved a delay of 0.00133 s, which is competitive with other methods.
  • ROC-AUC: The proposed method achieved the highest AUC of 0.953, indicating superior overall discriminative power.

Limitations and Future Work

  • Limitations: The paper acknowledges that the current method is based on the CRH2 type of high-speed train. Data from trains with different topological structures (out-of-distribution data) might negatively impact FD performance.
  • Future Work: The authors suggest extending the work to develop fault diagnosis and component localization capabilities. They also plan to explore fault detection for high-speed trains with diverse topological structures, addressing the out-of-distribution data challenge.

Summary updated

Abstract

The efficient fault detection (FD) of traction control systems (TCSs) is crucial for ensuring the safe operation of high-speed trains. Transient faults (TFs) can arise due to prolonged operation and harsh environmental conditions, often being masked by background noise, particularly during dynamic operating conditions. Moreover, acquiring a sufficient number of samples across the entire scenario presents a challenging task, resulting in imbalanced data for FD. To address these limitations, an unsupervised transfer learning (TL) method via federated Cycle-Flow adversarial networks (CFANs) is proposed to effectively detect TFs under various operating conditions. Firstly, a CFAN is specifically designed for extracting latent features and reconstructing data in the source domain. Subsequently, a transfer learning framework employing federated CFANs collectively adjusts the modified knowledge resulting from domain alterations. Finally, the designed federated CFANs execute transient FD by constructing residuals in the target domain. The efficacy of the proposed methodology is demonstrated through comparative experiments.
BibTeX
@inproceedings{yang2024unsupervised,
  author = {Xiaoyue Yang and Long Chen and Qidong Feng and Yucheng Yang and Sen Xie},
  title = {{Unsupervised Transfer Learning Method via Cycle-Flow Adversarial Networks for Transient Fault Detection under Various Operation Conditions}},
  booktitle = {Sensors},
  year = {2024},
  doi = {10.3390/s24154839},
}
Figure