Sensor Fault Detection and Isolation in Autonomous Nonlinear Systems Using Neural Network-Based Observers

John Cao, Muhammad Umar B. Niazi, Matthieu Barreau, Karl Henrik Johansson

TL;DR

This paper introduces a robust framework for detecting and isolating sensor faults in general nonlinear systems by leveraging neural network-based Kazantzis-Kravaris/Luenberger (KKL) observers. By combining theoretical residual bounds for fault detection with a novel differentiated residual approach for fault isolation, the method effectively identifies both complete sensor failures and gradual degradations even in the presence of measurement noise and model uncertainty.

What Problem Does This Paper Address?

In complex autonomous systems, sensors are the primary windows into the state of the process. When a sensor fails completely or begins to drift (degradation), it can lead to catastrophic system failure if not caught early. While "hardware redundancy" (using multiple physical sensors for the same measurement) is a solution, it is often too expensive or bulky.

"Analytical redundancy"—using mathematical models to predict what a sensor should be reading and comparing it to the actual measurement—is a preferred alternative. However, designing these observers for nonlinear systems is notoriously difficult. Most existing methods require the system to have a very specific mathematical structure (like a triangular form), which limits their real-world applicability. The authors aim to create a general-purpose sensor Fault Detection and Isolation (s-FDI) method that works for a broad class of nonlinear systems without restrictive structural assumptions.

Methods

The core of the approach is the Neural Network-based KKL (NN-KKL) Observer.

  1. KKL Lifting: The KKL framework "lifts" a complex nonlinear system into a higher-dimensional state space where the dynamics become linear and stable.
  2. Neural Network Approximation: Instead of solving the grueling partial differential equations usually required to find the KKL transformation, the authors use neural networks to learn the mapping ($T$) and its inverse ($T^*$).
  3. Residual Generation: The observer predicts the system output ($\hat{y}$). The difference between the actual measurement ($y$) and this prediction is the residual ($r$).
  4. Detection: The authors derive a theoretical threshold ($\tau$). If a residual exceeds this threshold, a fault is detected.
  5. Isolation via Differentiation: A major challenge in nonlinear observers is that a fault in one sensor often causes residuals to spike across all sensors because the observer's internal states are coupled. To solve this, the authors propose using differentiated residuals—the numerical derivative of the residual. They found that abrupt faults create a distinct "spike" in the derivative that is highly localized to the specific faulty sensor, allowing for accurate isolation.

Datasets

The method was evaluated using numerical simulations of a network of 10 Kuramoto oscillators, a standard model for studying synchronization in systems like power grids and multi-agent robotics.

  • Training Data: Generated using Latin hypercube sampling within the state space $X \subset [-2, 2]^{10}$.
  • Test Data: 100 initial conditions were used to generate noise-free, fault-free trajectories to establish empirical thresholds for the isolation task.

Key Insights and Ideas

  • Decoupling via Dynamics: The most significant "aha moment" is the use of differentiated residuals for isolation. Because the neural network transformation is non-diagonal, a fault in sensor A naturally "leaks" into the residual of sensor B. However, the instantaneous change (the derivative) at the moment of failure is much stronger in the faulty sensor's signal, providing a clear signature for isolation.
  • Theoretical Rigor: Unlike many purely data-driven deep learning approaches, this method provides theoretical upper bounds on residuals under fault-free conditions, giving engineers a principled way to set detection thresholds.
  • Generalizability: By using the KKL framework, the method avoids the "curse of structure." It doesn't care if your system is in a specific canonical form, making it applicable to a much wider variety of nonlinear dynamics.

Key Results

The observer demonstrated high accuracy in state estimation even under process and measurement noise, as shown in the tracking of unmeasured states $\theta_7$ and $\theta_8$:

Fig. 1: Estimated and true trajectories of states θ7 and θ8 under the influence of process and sensor noise.

In fault scenarios (detailed in Figure 2 below), the method successfully:

  • Detected and isolated complete failures (sensor shutdowns).
  • Identified multiple simultaneous faults occurring at different times.
  • Handled gradual degradations, such as increasing white noise or sinusoidal drift, though isolation in these cases often occurs with a slight delay compared to abrupt faults.
Fig. 2: (a) Complete failure of sensor 4. (b) Degradation of sensor 1 and 5 at different time points with abrupt faults. (c) Smooth sigmoidal fault in sensor 2. (d) Gradually increasing white noise in sensor 3. (e) Gradually increasing sinusoidal signal in sensor 3.

Limitations and Future Work

  • Smooth Faults: The isolation method relies on the "spike" in the differentiated residual. If a fault is extremely smooth and low-magnitude (like a very slow sigmoidal drift), it may be detected but remain difficult to isolate to a specific sensor.
  • Autonomous Systems: The current work focuses on autonomous systems (those without external control inputs). Extending this to non-autonomous systems is a primary goal for future research.
  • Real-world Validation: While the Kuramoto model is a robust benchmark, testing the framework on physical experimental data or high-fidelity industrial simulators is the next logical step.

Summary updated

Abstract

This paper presents a novel observer-based approach to detect and isolate faulty sensors in nonlinear systems. The proposed sensor fault detection and isolation (s-FDI) method applies to a general class of nonlinear systems. Our focus is on s-FDI for two types of faults: complete failure and sensor degradation. The key aspect of this approach lies in the utilization of a neural network-based Kazantzis-Kravaris/Luenberger (KKL) observer. The neural network is trained to learn the dynamics of the observer, enabling accurate output predictions of the system. Sensor faults are detected by comparing the actual output measurements with the predicted values. If the difference surpasses a theoretical threshold, a sensor fault is detected. To identify and isolate which sensor is faulty, we compare the numerical difference of each sensor meassurement with an empirically derived threshold. We derive both theoretical and empirical thresholds for detection and isolation, respectively. Notably, the proposed approach is robust to measurement noise and system uncertainties. Its effectiveness is demonstrated through numerical simulations of sensor faults in a network of Kuramoto oscillators.
BibTeX
@inproceedings{cao2023sensor,
  author = {John Cao and Muhammad Umar B. Niazi and Matthieu Barreau and Karl Henrik Johansson},
  title = {{Sensor Fault Detection and Isolation in Autonomous Nonlinear Systems Using Neural Network-Based Observers}},
  booktitle = {ECC},
  year = {2023},
  doi = {10.48550/arxiv.2304.08837},
}
Figure