Dynamic Vision-Based Non-Contact Rotating Machine Fault Diagnosis with EViT

Zhi Jin, Cuiying Sun, Xiang LiSensors 2025 · DOI

TL;DR

This paper introduces a novel non-contact fault diagnosis method for rotating machinery using event-based cameras and a new deep learning architecture called the Eagle Vision Transformer (EViT). EViT effectively processes the unique data from event cameras, achieving superior accuracy in identifying machine faults compared to traditional Convolutional Neural Networks (CNNs).

What Problem Does This Paper Address?

Traditional methods for diagnosing faults in rotating machinery often rely on contact-based sensors like accelerometers to measure vibrations. While effective, these sensors have limitations: they require physical attachment, can be difficult to install in certain environments, and can even influence the system's dynamics. Non-contact methods, like laser sensors or event-based cameras, offer advantages by avoiding physical contact, reducing installation complexity, and not affecting the machine's operation. However, the data generated by event-based cameras is asynchronous and has a complex structure, making it challenging to process with standard deep learning models like CNNs, which are designed for regular, synchronous image data. This paper aims to bridge this gap by developing a method to effectively utilize event-based camera data for accurate and non-contact fault diagnosis.

Methods

The core of this work is the Eagle Vision Transformer (EViT) architecture. EViT is designed to process the asynchronous, per-pixel brightness change data from event cameras. Key innovations include:

  • Bi-Fovea Self-Attention (BFSA): This mechanism mimics the foveal vision of eagles, employing a "coarse-to-fine" approach. It uses a shallow branch to capture global scene context and a deep branch to refine details at specific locations, allowing for efficient and effective feature extraction.
  • Bi-Fovea Feedforward Network (BFFN): This component works in conjunction with BFSA to further process features, contributing to the model's ability to diagnose complex faults.
  • Convolutional Positional Embedding (CPE): Unlike traditional positional encodings in Transformers, CPE uses depth-wise convolutions, making it resolution-independent and more robust to variations in input size.
  • Event Data Representation: The paper proposes a novel two-channel representation that separates positive and negative polarity events, preserving the temporal and spatial characteristics of the machine's vibrations.

The overall framework involves acquiring event data, preprocessing it into the proposed representation, feeding it into the EViT model for training, and then using the trained model for fault diagnosis.

Datasets

The study utilizes experimental data acquired from a dedicated rolling element bearing test platform. This platform simulates four distinct mechanical health states: healthy operation, inner race defect, rolling element defect, and outer race defect. The data was collected under varying rotational speeds (1200, 1500, and 1800 RPM). While this is a real-world dataset, it's not explicitly presented as a newly introduced benchmark dataset for public release, but rather as the experimental basis for their validation.

Key Insights and Ideas

  • Event cameras are powerful for capturing transient mechanical phenomena: Their high temporal resolution and dynamic range make them ideal for detecting subtle vibrations that might be missed by conventional cameras.
  • EViT's bio-inspired design is crucial: The "fovea" concept in BFSA allows for efficient processing of complex visual data by focusing on both global context and fine details, which is highly beneficial for fault diagnosis.
  • Non-contact sensing with event cameras can rival contact sensors: The proposed method demonstrates that event-based vision can achieve high accuracy in fault diagnosis, offering a viable alternative to traditional vibration sensors.
  • EViT excels in cross-condition generalization: The model shows a significant advantage over CNNs when dealing with data from varying operating conditions, suggesting better robustness for real-world industrial applications.

Key Results

  • Superior Accuracy: The EViT model consistently achieved testing accuracies above 95% across various fault diagnosis tasks, often outperforming conventional CNN models. For example, in Task B1, EViT achieved 98.8% accuracy compared to CNN's 96.1%.
  • Improved Feature Representation: Visualization of learned features using t-SNE showed that EViT creates tighter intra-class clusters and more distinct inter-class boundaries, indicating better separation of fault states.
  • Robustness to Operating Conditions: EViT demonstrated significantly better performance gains when trained on heterogeneous operational data (e.g., multiple speeds) compared to CNNs, highlighting its adaptability to changing machine conditions.
  • Module Importance: Ablation studies showed that removing key EViT modules (BFSA, BFFN, CPE) led to substantial accuracy decreases, underscoring the critical role of each component.

Limitations and Future Work

  • Computational Complexity: The quadratic spatial complexity of the BFSA mechanism increases FLOPs and GPU memory usage, making real-time deployment on resource-constrained edge devices challenging.
  • Data Dependency: The Transformer backbone of EViT requires substantial labeled data for optimal performance. In small-sample scenarios, its accuracy can drop below that of lightweight CNNs.
  • Future Directions: The authors suggest future research should focus on enhancing the model's environmental generalization capability and optimizing its network architecture to address the identified limitations. This includes exploring ways to reduce computational overhead and improve performance in low-data regimes.

Summary updated

Abstract

Event-based cameras, as a revolutionary class of dynamic vision sensors, offer transformative advantages for capturing transient mechanical phenomena through their asynchronous, per-pixel brightness change detection mechanism. These neuromorphic sensors excel in challenging industrial environments with their microsecond-level temporal resolution, ultra-low power requirements, and exceptional dynamic range that significantly outperform conventional imaging systems. In this way, the event-based camera provides a promising tool for machine vibration sensing and fault diagnosis. However, the dynamic vision data from the event-based cameras have a complex structure, which cannot be directly processed by the mainstream methods. This paper proposes a dynamic vision-based non-contact machine fault diagnosis method. The Eagle Vision Transformer (EViT) architecture is proposed, which incorporates biologically plausible computational mechanisms through its innovative Bi-Fovea Self-Attention and Bi-Fovea Feedforward Network designs. The proposed method introduces an original computational framework that effectively processes asynchronous event streams while preserving their inherent temporal precision and dynamic response characteristics. The proposed methodology demonstrates exceptional fault diagnosis performance across diverse operational scenarios through its unique combination of multi-scale spatiotemporal feature analysis, adaptive learning capabilities, and transparent decision pathways. The effectiveness of the proposed method is extensively validated by the practical condition monitoring data of rotating machines. By successfully bridging cutting-edge bio-inspired vision processing with practical industrial monitoring requirements, this work creates a new paradigm for dynamic vision-based non-contact machinery fault diagnosis that addresses critical limitations of conventional approaches. The proposed method provides new insights for predictive maintenance applications in smart manufacturing environments.
BibTeX
@inproceedings{jin2025dynamic,
  author = {Zhi Jin and Cuiying Sun and Xiang Li},
  title = {{Dynamic Vision-Based Non-Contact Rotating Machine Fault Diagnosis with EViT}},
  booktitle = {Sensors},
  year = {2025},
  doi = {10.3390/s25175472},
}
Figure