Attacking for Inspection and Instruction: Debiasing Self-explaining Text Classification

Wei Liu, Jun Wang, Haozhao Wang, Ruixuan Li, Zhiying Deng, YuanKai ZhangOpenReview 2024 · Submission to ICLR 2024 · Withdrawn · OpenReview

Its authors withdrew this paper, so there is no full text to read or summarize.

Abstract

eXplainable Artificial Intelligence (XAI) techniques are indispensable for increasing the transparency of deep learning models. Such transparency facilitates a deeper human comprehension of the model's fairness, security, robustness, among other attributes, leading to heightened trust in the model's decisions. An important line of research in the field of NLP involves self-explanation using a cooperative game, where a generator selects a semantically consistent subset of the input as the explanation, and a subsequent predictor makes predictions based on the selected subset. In this paper, we first uncover a potential caveat: such a cooperative game could unintentionally introduce a sampling bias between the explanation and the target prediction label. Specifically, the generator might inadvertently create an incorrect correlation between the selected explanation and the label, even when they are semantically unrelated in the original dataset. Subsequently, we elucidate the origins of this bias using both theoretical analysis and empirical evidence. Our findings suggest a direction for mitigating this bias, and we introduce an adversarial game as a practical solution. Experiments on two widely used real-world benchmarks show the effectiveness of the proposed method.
BibTeX
@misc{liu2024attacking,
  author = {Wei Liu and Jun Wang and Haozhao Wang and Ruixuan Li and Zhiying Deng and YuanKai Zhang},
  title = {{Attacking for Inspection and Instruction: Debiasing Self-explaining Text Classification}},
  year = {2024},
  url = {https://openreview.net/forum?id=SdoSUDBWJY},
  howpublished = {OpenReview},
  note = {Submitted to ICLR 2024},
}

Loading related content...

Figure