INTERACTION: A Generative XAI Framework for Natural Language Inference Explanations

Jialin Yu, Alexandra I. Cristea, Anoushka Harit, Zhongtian Sun, Olanrewaju Tahir Aduragba, Lei Shi, Noura Al Moubayed

TL;DR

The INTERACTION framework moves beyond "one-size-fits-all" AI explanations by using a generative approach to produce multiple, diverse natural language justifications for its decisions. By combining Transformers with a novel Conditional Variational Autoencoder (CVAE) architecture, the researchers demonstrate that generating explanations doesn't just help humans understand the AI—it actually helps the AI make more accurate predictions.

What Problem Does This Paper Address?

Deep learning models are notoriously "black boxes." While Explainable AI (XAI) aims to fix this by providing human-readable evidence for a model's decision, most current methods only provide a single explanation.

From a Human-Computer Interaction (HCI) perspective, this is a flaw. Human thought is diverse; two people might explain the same conclusion in different ways based on their background, social expectations, or cognitive biases. Furthermore, Natural Language Inference (NLI) datasets often contain "annotation artifacts"—spurious correlations that allow models to "cheat" and guess labels without truly understanding the logic. The authors argue that a robust XAI system should be able to provide a variety of valid explanations and that this process should be deeply integrated with the decision-making itself.

Methods

The authors propose the INTERACTION framework (explaIn aNd predicT thEn queRy with contextuAl CondiTional varIational autO-eNcoder). It operates in two distinct steps:

  1. Explanation and Label Prediction: The model predicts the most probable label (e.g., Entailment, Contradiction, or Neutral) and a primary explanation simultaneously.
  2. Diverse Evidence Generation: Using a deep generative model, the system explores the "latent space" (a mathematical representation of possible explanations) to generate multiple, diverse alternative justifications.

Technical Highlights:

  • The "Concoder": Standard Transformers produce variable-length sequences, which are tricky to plug into the fixed-size latent distributions required by Variational Autoencoders. The authors introduced a Contextual Convolutional Neural Encoder (Concoder) that uses 2D-convolutions (unigram, bigram, and trigram filters) to "flatten" Transformer outputs into a stable format for the generative process.
  • Joint Training: The framework explores three variants (M1, M2, M3) to test how labels should be predicted: based on the input only, the explanation only, or both combined.

Datasets

The study utilizes e-SNLI (extended Stanford Natural Language Inference). This is a large-scale benchmark dataset where every premise-hypothesis pair is supplemented with human-written natural language explanations. It is currently the gold standard for training models that need to "reason" in plain English.

Key Insights and Ideas

  • Explanations Improve Accuracy: One of the most significant "aha moments" was that models trained to generate explanations actually became better at the primary task. The INTERACTION M1 model outperformed the standard Transformer baseline in label accuracy, suggesting that the requirement to "explain itself" forces the model to learn better semantic representations.
  • The "Cheating" Problem: The authors confirmed that models can easily pick up on spurious correlations (e.g., guessing a label just by looking at the hypothesis and ignoring the premise). However, they found that generating explanations significantly reduces the impact of these shortcuts, making the model's reasoning more grounded.
  • Latent Space Diversity: By performing posterior analysis and interpolating within the CVAE's latent space, the model successfully generated multiple linguistically different but semantically valid explanations for the same data point. This mirrors how different humans might describe the same logic using different words.

Key Results

  • Performance Gains: The INTERACTION framework achieved a 4.4% gain in accuracy and up to a 4.7% gain in BLEU score (a measure of text quality) compared to state-of-the-art baselines.
  • Label Accuracy: The M1 variant reached 83.42% accuracy, significantly higher than the Mixture Transformer Encoder baseline of 78.98%.
  • Qualitative Success: In tests, the model could generate three distinct, valid explanations for a single inference. For example, for a "Contradiction" label, it might generate: "The boy cannot be playing and sitting at the same time," and "The boy is either playing or sitting, not both."

Limitations and Future Work

While the framework is a leap forward for diverse XAI, the authors note several areas for growth:

  • Decoding Strategy: The model currently uses MAP (Maximum A Posteriori) decoding. While efficient, it may not always capture the most creative or linguistically rich explanations.
  • Human Evaluation: The "Correct@100" metric used for qualitative assessment is manual and labor-intensive. Developing automated metrics that can judge the "truthfulness" of diverse explanations remains a challenge.
  • HCI Utility: The paper raises an open question for the HCI community: How many explanations are "too many"? Future work is needed to determine how users interact with multiple explanations and how they choose which one to trust.

Summary updated

Abstract

XAI with natural language processing aims to produce human-readable explanations as evidence for AI decision-making, which addresses explainability and transparency. However, from an HCI perspective, the current approaches only focus on delivering a single explanation, which fails to account for the diversity of human thoughts and experiences in language. This paper thus addresses this gap, by proposing a generative XAI framework, INTERACTION (explain aNd predicT thEn queRy with contextuAl CondiTional varIational autO-eNcoder). Our novel framework presents explanation in two steps: (step one) Explanation and Label Prediction; and (step two) Diverse Evidence Generation. We conduct intensive experiments with the Transformer architecture on a benchmark dataset, e-SNLI [1]. Our method achieves competitive or better performance against state-of-the-art baseline models on explanation generation (up to 4.7% gain in BLEU) and prediction (up to 4.4% gain in accuracy) in step one; it can also generate multiple diverse explanations in step two.
BibTeX
@inproceedings{yu2022interaction,
  author = {Jialin Yu and Alexandra I. Cristea and Anoushka Harit and Zhongtian Sun and Olanrewaju Tahir Aduragba and Lei Shi and Noura Al Moubayed},
  title = {{INTERACTION: A Generative XAI Framework for Natural Language Inference Explanations}},
  booktitle = {IJCNN},
  year = {2022},
  url = {https://openreview.net/forum?id=cld-TGiLmB},
}

Loading related content...

Figure