Anomaly Detection Under Multiplicative Noise Model Uncertainty

Venkatraman Renganathan, Benjamin J. Gravell, Justin Ruths, Tyler H. Summers

TL;DR

This paper tackles the challenge of detecting anomalies in cyber-physical systems (CPS) when the system's model is uncertain, a common issue in real-world applications. They introduce a novel anomaly detection framework that explicitly accounts for this model uncertainty using a multiplicative noise model, leading to more robust and reliable anomaly detection.

What Problem Does This Paper Address?

Cyber-physical systems (CPS) are everywhere, from smart grids to autonomous vehicles. Monitoring these systems for anomalies (e.g., cyberattacks or sensor failures) is critical for their safe and reliable operation. Traditional anomaly detection methods often rely on accurate mathematical models of the CPS. However, real-world systems are rarely perfectly known; they suffer from modeling errors due to factors like nonlinearities, learned models, or changing environmental conditions. These uncertainties make it difficult to distinguish genuine anomalies from expected deviations caused by model inaccuracies. Existing methods often assume additive noise, which doesn't fully capture the complex ways model uncertainties can affect system dynamics. This paper addresses this gap by developing an anomaly detection approach that specifically handles multiplicative noise, which better represents how model uncertainties can scale with system states and control inputs.

Methods

The core of this paper's contribution lies in its novel approach to anomaly detection under multiplicative noise uncertainty. Here's a breakdown:

  • Multiplicative Noise Framework: Instead of assuming uncertainties are simply added to the system model (additive noise), the authors model them as multiplicative factors that scale with the system's state and control inputs. This is a more realistic representation of many real-world uncertainties.
  • Multiplicative Noise LQG (MLQG) Compensator: To handle this multiplicative noise, they leverage a specialized state estimator and controller called the Multiplicative Noise Linear Quadratic Gaussian (MLQG) compensator. This compensator is designed to jointly compute optimal controller and estimator gains, a departure from traditional methods that can separate these tasks. This joint computation is crucial because the separation principle, common in additive noise settings, breaks down with multiplicative noise.
  • Residual Generation: The MLQG compensator produces a "residual" signal, which is the difference between the system's actual output and its estimated output. In a well-functioning system, this residual should be small and predictable.
  • Anomaly Detection Threshold: The authors propose a quadratic distance measure based on this residual. To set a threshold for detecting anomalies, they use a moment-based approach, specifically considering higher-order moments of the residual. This is important because the residual's distribution is non-Gaussian due to the multiplicative noise, making standard chi-squared detectors inappropriate. They then use this moment-based approach to guarantee a desired worst-case false alarm rate.

Datasets

Not discussed in the paper. The authors validate their approach using numerical simulations of an inverted pendulum system.

Key Insights and Ideas

  • Multiplicative Noise is Crucial for Realism: The paper strongly argues that multiplicative noise is a more accurate way to model uncertainties in CPS than simple additive noise, especially when dealing with scaling effects of states and controls.
  • Joint Controller-Estimator Design is Necessary: The breakdown of the separation principle under multiplicative noise highlights the need for integrated design of controllers and estimators to achieve robust performance.
  • Non-Gaussian Residuals Require Advanced Thresholding: The multiplicative noise inherently leads to non-Gaussian residual distributions, necessitating more sophisticated methods (like moment-based approaches) for setting reliable anomaly detection thresholds.
  • MLQG Offers Tighter Thresholds: Even when both standard LQG and MLQG can achieve mean-square compensation, the MLQG approach leads to a tighter anomaly detection threshold, implying better sensitivity to anomalies.

Key Results

The paper demonstrates through numerical simulations of an inverted pendulum system that their proposed MLQG-based anomaly detector:

  • Successfully accounts for multiplicative model uncertainty.
  • Achieves mean-square compensation of the system even with increasing multiplicative noise variances, up to a certain limit.
  • Results in a tighter anomaly detection threshold compared to a standard LQG approach when multiplicative noise is present.
  • Guarantees that the worst-case false alarm rate is upper-bounded by the desired value (e.g., 5%) using the moment-based thresholding.

Limitations and Future Work

  • Unknown Multiplicative Noise Distributions: The current work assumes the distributions of the multiplicative noise are known. A significant future direction is to investigate scenarios where these distributions are unknown and to develop methods for online estimation of system dynamics using techniques like system identification.
  • Numerical Stability at High Variances: The authors note that at very high multiplicative noise variances (e.g., > 3.77 in their simulations), numerical issues arise, and the coupled Riccati equations for MLQG stop converging, indicating a loss of mean-square compensation. Addressing this numerical stability is an area for future research.
  • Nonlinear Estimators: While the paper focuses on affine estimators, they acknowledge that nonlinear estimators could potentially offer better performance.
  • Data-Driven Approaches: The ultimate goal is to combine these robust estimation techniques with data-driven methods for truly robust anomaly detection in vulnerable CPS.

Summary updated

Abstract

State estimators are crucial components of anomaly detectors that are used to monitor cyber-physical systems. Many frequently-used state estimators are susceptible to model risk as they rely critically on the availability of an accurate state-space model. Modeling errors make it more difficult to distinguish whether deviations from expected behavior are due to anomalies or simply a lack of knowledge about the system dynamics. In this letter, we account for model uncertainty through a multiplicative noise framework. Specifically, we propose to use the multiplicative noise LQG based compensator in this setting to hedge against the model uncertainty risk. The size of the residual from the estimator can then be compared against a threshold to detect anomalies. Finally, the proposed detector is validated using numerical simulations. Extension of state-of-the-art anomaly detection in cyber-physical systems to handle model uncertainty represents the main novel contribution of the present work.
BibTeX
@inproceedings{renganathan2022anomaly,
  author = {Venkatraman Renganathan and Benjamin J. Gravell and Justin Ruths and Tyler H. Summers},
  title = {{Anomaly Detection Under Multiplicative Noise Model Uncertainty}},
  booktitle = {IEEE Control. Syst. Lett},
  year = {2022},
  url = {https://openreview.net/forum?id=PS5v0qD1vJ},
}
Figure