Deep Explainable Learning with Graph Based Data Assessing and Rule Reasoning

Yuanlong Li, Gaopan Huang, Min Zhou, Chuan Fu, Honglin Qiao, Yan He

TL;DR

Researchers have developed Deep Explainable Learning (DEL), a hybrid framework that combines the noise-handling power of Graph Neural Networks with the interpretability of expert-defined rules. By using a novel "gradient linking search" to bridge the gap between differentiable deep learning and non-differentiable logic, the system achieves the accuracy of black-box models while remaining fully transparent and significantly more stable in real-world industrial settings.

What Problem Does This Paper Address?

In the world of machine learning, we often face a frustrating trade-off. On one hand, Deep Learning models are incredibly good at "fitting" noisy, large-scale data, but they are notorious "black boxes" that are hard to explain and often fail when the data distribution shifts (poor generalization). On the other hand, Rule-Based Systems (like "if-then" logic provided by human experts) are perfectly transparent but struggle with noisy data and often require massive, unmanageable rule sets to achieve decent accuracy.

The authors tackle a specific industrial challenge: how do you use expert knowledge to make decisions when the incoming data is messy and the rules themselves might be slightly "fuzzy" or incomplete? Existing methods like Inductive Logic Programming (ILP) or standard Explainable AI (XAI) decorators often fall short because they can't handle data noise and rule optimization simultaneously in an end-to-end fashion.

Methods

The authors propose DEL (Deep Explainable Learning), which consists of three main components:

  1. Data Assessing Model (The Filter): This uses a Graph Neural Network (GNN) to treat data observations as nodes in a graph. It learns to identify correlations between different data points and generates a "mask" to filter out noise, effectively highlighting the "key features" for the next step.
  2. Rule Learning Model (The Logic): Instead of a standard neural network, this component is a "Rule Tree" translated into a differentiable structure. It replaces logical AND/OR operations with min/max functions and uses tanh to approximate step functions. This allows the model to "tune" the thresholds of expert rules (e.g., changing a rule from "Value > 10" to "Value > 10.5") using standard optimization.
  3. Gradient Linking Search (The Bridge): This is the most novel part. Because some rule-based operations (like SQL queries) are non-differentiable, the gradient "breaks" and can't flow back to train the Data Assessing Model. The authors use a stochastic search procedure—essentially a smart random walk on the data graph—to find which data points, when kept, lead to a correct rule-based prediction. This provides a "target" to train the deep learning filter.

Datasets

The model was tested on an industrial product quality evaluation system using two primary datasets:

  • $V_{general}$: Data collected from daily production. It is extremely unbalanced (many more "qualified" products than "unqualified" ones).
  • $V_{special}$: A specially curated dataset with stricter quality controls and a more balanced distribution of labels.

These datasets represent the "real-world" messiness of industrial sensors and human expert labeling.

Key Insights and Ideas

  • Stability over Brute Force: The most striking insight is that while deep ensemble models (the baseline) can achieve near-perfect scores on training data, they "crash" when moved to a different dataset. DEL, by being anchored in human logic, maintains much higher stability.
  • Simulating the Human Expert: The architecture mimics how a human works: first, you look at the messy data and pick out what's important (Data Assessing), then you apply your "fuzzy" rules to those specific points (Rule Reasoning).
  • The Power of "Critical Features": The authors found that including human-labeled "critical features" (knowing why a human expert made a choice) significantly helps the model navigate the massive search space of potential rules.

Key Results

The researchers compared DEL against a basic Rule-Based (BR) model and a powerful Deep Ensemble Model (DEM).

  • Generalization: In "Open Tests" (training on one dataset and testing on another), DEL significantly outperformed the Deep Ensemble. For example, when moving from $V_{special}$ to $V_{general}$, DEL achieved a Recall of 0.7253 and Accuracy of 0.8429, while the Deep Ensemble's accuracy plummeted to 0.3549.
  • Accuracy: In "Closed Tests" (same dataset for train/test), DEL achieved comparable accuracy to the Deep Ensemble, proving that you don't have to sacrifice much performance to gain explainability.
  • Interpretability: Unlike the Deep Ensemble, DEL provides the exact optimized rule and the specific data points it used to reach a conclusion, making it "production-ready" for industries that require audit trails.

Limitations and Future Work

While powerful, DEL has a few constraints:

  • Dependency on Experts: It requires a pre-defined set of expert rules to start with. It optimizes rules but doesn't "invent" entirely new logical structures from scratch.
  • Label Intensity: The model performs best when it has access to "critical feature" labels (knowing which specific part of the data triggered the expert's decision), which can be expensive to collect.
  • Scalability of Search: The Gradient Linking Search relies on random walks and greedy search; as the complexity of the data graph grows, this search could become a computational bottleneck.

The authors suggest that future work could involve making the rule-generation process even more automated while maintaining the "human-in-the-loop" transparency that makes this approach so valuable.

Summary updated

Abstract

Learning an explainable classifier often results in low accuracy model or ends up with a huge rule set, while learning a deep model is usually more capable of handling noisy data at scale, but with the cost of hard to explain the result and weak at generalization. To mitigate this gap, we propose an end-to-end deep explainable learning approach that combines the advantage of deep model in noise handling and expert rule-based interpretability. Specifically, we propose to learn a deep data assessing model which models the data as a graph to represent the correlations among different observations, whose output will be used to extract key data features. The key features are then fed into a rule network constructed following predefined noisy expert rules with trainable parameters. As these models are correlated, we propose an end-to-end training framework, utilizing the rule classification loss to optimize the rule learning model and data assessing model at the same time. As the rule-based computation is none-differentiable, we propose a gradient linking search module to carry the gradient information from the rule learning model to the data assessing model. The proposed method is tested in an industry production system, showing comparable prediction accuracy, much higher generalization stability and better interpretability when compared with a decent deep ensemble baseline, and shows much better fitting power than pure rule-based approach.
BibTeX
@misc{li2022deep,
  author = {Yuanlong Li and Gaopan Huang and Min Zhou and Chuan Fu and Honglin Qiao and Yan He},
  title = {{Deep Explainable Learning with Graph Based Data Assessing and Rule Reasoning}},
  year = {2022},
  eprint = {2211.04693},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2211.04693},
}
Figure