Diagnosing a Strong-Fault Model by Conflict and Consistency

Wenfeng Zhang, Qi Zhao, Hongbo Zhao, Gan Zhou, Wenquan FengSensors 2018 · OpenReview

TL;DR

This paper introduces a novel approach for diagnosing "strong-fault" models, which are more complex than traditional "weak-fault" models. By simultaneously leveraging both conflicts (discrepancies between predicted and observed behavior) and consistencies (agreement between predicted and observed behavior), the authors develop more efficient and accurate diagnostic methods. This work is crucial for improving the reliability of complex systems where faults have specific, predictable behaviors.

What Problem Does This Paper Address?

Diagnosing faults in complex systems is critical for ensuring safety and reliability. Traditional fault diagnosis methods often rely on "weak-fault" models, where a component's behavior is only well-defined in its normal state. However, many modern systems require "strong-fault" models, which explicitly define the behavior of components even when they are in a faulty state. Diagnosing these strong-fault models is significantly more challenging due to their non-monotonic nature. Existing methods primarily focus on identifying conflicts to pinpoint faults, but they often overlook the valuable information provided by consistencies, which can indicate normal component behavior. This paper aims to bridge this gap by developing a diagnostic framework that effectively utilizes both conflicts and consistencies for strong-fault models.

Methods

The core of the proposed solution lies in a novel Multi-Conflict Multi-Consistency Logic-based Truth Maintenance System (MCMC-LTMS). This system is designed to reason over Boolean-encoded system models (converted to Conjunctive Normal Form - CNF) and simultaneously identify multiple minimal conflicts and maximal consistencies.

Key methodological contributions include:

  • Model Encoding: Multi-valued variables (representing component modes) are encoded into Boolean variables, allowing standard logic-based reasoning techniques to be applied.
  • MCMC-LTMS: This system enhances traditional LTMS by:
  • Multi-Conflict Detection: It employs an "out-ignorance" strategy to continue reasoning even when an initial conflict is found, allowing it to discover multiple conflicts.
  • Multi-Consistency Detection: It identifies maximal consistencies by employing techniques like unit propagation delay and handling unknown variables.
  • A* Search Algorithms: Two A* search-based algorithms are proposed:
  • Conflict and Consistency Directed Local Sequential A* search (CCDLSA*): Designed for single diagnosis, it focuses the search on components involved in conflicts, making it efficient.
  • Conflict and Consistency Directed Global A* search (CCDGA*): Designed for multiple diagnoses, it explores a broader search space to find all possible diagnoses.
  • Probabilistic Model: A refined probabilistic model is introduced to better evaluate the likelihood of diagnoses by considering both prior probabilities and the implications of conflicts and consistencies.

Datasets

The proposed methods are evaluated on a real-world case study: a heat control unit of a spacecraft. This system is described as having 20 components and a search space of approximately 6.5 x 10^10, making it a challenging benchmark. The paper does not introduce new benchmark datasets but uses this complex system to demonstrate the effectiveness of their approach.

Key Insights and Ideas

  • Consistency is as important as Conflict: The paper highlights that while conflicts point to potential faults, consistencies strongly suggest normal behavior. Ignoring consistencies leads to a less efficient and potentially less accurate diagnosis.
  • Strong-Fault Models are Non-Monotonic: This inherent complexity necessitates new approaches that can handle situations where adding a fault might not necessarily increase conflicts, or where multiple faults can interact in non-obvious ways.
  • Simultaneous Conflict and Consistency Reasoning is Powerful: The MCMC-LTMS effectively leverages both types of information in a single reasoning pass, significantly improving diagnostic efficiency and accuracy compared to methods that only consider conflicts.
  • A* Search Benefits from Combined Information: By using conflicts and consistencies to guide the A* search, the proposed algorithms can prune the search space more effectively, avoiding the exploration of improbable candidates.

Key Results

  • Efficiency Gains: Both CCDLSA* (for single diagnosis) and CCDGA* (for multiple diagnoses) significantly outperform traditional methods like Best First A* (BFA*) and Conflict Directed A* (CDA*).
  • For single diagnosis, CCDLSA* reduced diagnosis time by up to 33.33% compared to BFA*.
  • For three diagnoses, CCDGA* reduced diagnosis time by 30.28% compared to BFA*.
  • Reduced Search Space: The proposed algorithms explored significantly fewer nodes and tried fewer candidates, indicating more efficient search strategies and reduced memory usage. For example, CCDLSA* tried the least candidates and expanded the least nodes in single diagnosis scenarios.
  • Robustness: The algorithms demonstrated robustness, especially when the prior probabilities of component modes were "sharp" (i.e., one mode was significantly more likely than others).
  • Effectiveness on Complex Systems: The methods successfully diagnosed faults in a complex spacecraft heat control system, demonstrating their applicability to real-world scenarios.

Limitations and Future Work

  • Completeness of Unit Propagation: While the authors argue MCMC-LTMS is complete for strong-fault models, they acknowledge that unit propagation itself is theoretically incomplete for general Boolean logic.
  • Assumption of Faults Causing Conflicts: The coverage analysis relies on the assumption that fault components will always cause at least one conflict. If this assumption is not met, coverage might not be ensured.
  • Prior Distribution Sensitivity: The robustness of the A* search algorithms is dependent on the "sharpness" of the prior probability distributions. Flat distributions can lead to more backtracking and reduced robustness.
  • Incremental Consistency Use: A limitation is that consistencies found in the first iteration are used, but consistencies found later in the search could change node weights, potentially requiring search tree reconstruction.
  • Future Work: The authors suggest investigating how to incrementally use consistencies during the search process to further improve efficiency.

Summary updated

Abstract

The diagnosis method for a weak-fault model with only normal behaviors of each component has evolved over decades. However, many systems now demand a strong-fault models, the fault modes of which have specific behaviors as well. It is difficult to diagnose a strong-fault model due to its non-monotonicity. Currently, diagnosis methods usually employ conflicts to isolate possible fault and the process can be expedited when some observed output is consistent with the model’s prediction where the consistency indicates probably normal components. This paper solves the problem of efficiently diagnosing a strong-fault model by proposing a novel Logic-based Truth Maintenance System (LTMS) with two search approaches based on conflict and consistency. At the beginning, the original a strong-fault model is encoded by Boolean variables and converted into Conjunctive Normal Form (CNF). Then the proposed LTMS is employed to reason over CNF and find multiple minimal conflicts and maximal consistencies when there exists fault. The search approaches offer the best candidate efficiency based on the reasoning result until the diagnosis results are obtained. The completeness, coverage, correctness and complexity of the proposals are analyzed theoretically to show their strength and weakness. Finally, the proposed approaches are demonstrated by applying them to a real-world domain—the heat control unit of a spacecraft—where the proposed methods are significantly better than best first and conflict directly with A* search methods.
BibTeX
@inproceedings{zhang2018diagnosing,
  author = {Wenfeng Zhang and Qi Zhao and Hongbo Zhao and Gan Zhou and Wenquan Feng},
  title = {{Diagnosing a Strong-Fault Model by Conflict and Consistency}},
  booktitle = {Sensors},
  year = {2018},
  url = {https://openreview.net/forum?id=wWGFf2MsMM},
}

Loading related content...

Figure