Exploring the Trade-off between Plausibility, Change Intensity and Adversarial Power in Counterfactual Explanations using Multi-objective Optimization

Javier Del Ser, Alejandro Barredo Arrieta, Natalia Díaz Rodríguez, Francisco Herrera, Andreas HolzingerarXiv 2022 · OpenReview

TL;DR

This paper introduces a novel framework for generating counterfactual explanations for deep learning models. It tackles the challenge of creating explanations that are not only effective at changing a model's prediction (adversarial power) but also realistic (plausible) and minimally altered from the original input. By framing this as a multi-objective optimization problem, the authors provide a more nuanced understanding of model behavior and potential biases.

What Problem Does This Paper Address?

Deep learning models are increasingly used in critical applications, but their "black-box" nature makes it hard to understand why they make certain decisions. Counterfactual explanations offer a way to build trust by showing what minimal changes to an input would alter the model's output. However, existing methods often focus solely on the "adversarial power" (how much the prediction changes) without adequately considering:

  1. Plausibility: Is the counterfactual example realistic and likely to occur in the real world?
  2. Change Intensity: How much was the original input modified to create the counterfactual?

This gap limits the trustworthiness and interpretability of counterfactuals, especially for non-expert users. The authors aim to bridge this by developing a framework that balances these crucial aspects.

Methods

The core of the proposed framework is a multi-objective optimization approach combined with Generative Adversarial Networks (GANs).

  • GANs for Plausibility: A GAN is trained to learn the underlying data distribution. Its generator creates synthetic examples, and its discriminator acts as a plausibility checker, ensuring generated counterfactuals are realistic.
  • Multi-objective Optimization: A meta-heuristic solver (specifically, NSGA2) is employed to search for counterfactuals that simultaneously optimize three objectives:
  • Plausibility: Measured by the GAN's discriminator.
  • Adversarial Power: How much the counterfactual changes the audited model's prediction.
  • Change Intensity: The magnitude of the perturbation applied to the original input.
  • Black-Box Auditing: The framework is designed to work with pre-trained, "black-box" models, meaning it doesn't require access to the model's internal architecture or gradients.

Datasets

The framework was evaluated on six classification tasks using various datasets:

  • Image Data:
    • Edges2Shoes (for footwear classification)
    • CelebA (for face attribute editing)
    • ImageNet (for general image classification)
    • ShapeNet (for 3D object classification)
    • Style (for image classification)
    • MNIST (for digit classification)

The paper does not introduce new datasets but uses existing ones to demonstrate the framework's versatility across different data modalities and task complexities.

Key Insights and Ideas

  • Counterfactuals are inherently multi-objective: Generating useful counterfactuals isn't just about making a prediction flip; it's about finding a sweet spot between realism, minimal change, and predictive power.
  • GANs are powerful tools for generating plausible counterfactuals: The ability of GANs to model complex data distributions is crucial for ensuring that generated counterfactuals are not just arbitrary changes but are grounded in reality.
  • Bias detection through counterfactuals: The framework can reveal hidden biases in training data. For example, in the face-gender experiment, counterfactuals highlighted how certain attributes (like blonde hair, glasses, or a smile) were disproportionately associated with the female class in the training data, potentially leading to misclassifications.
  • Understanding model limitations: By visualizing the trade-offs between objectives, users can gain a deeper understanding of where a model is robust and where it is vulnerable.

Key Results

The experiments demonstrated that the proposed framework can generate multi-faceted counterfactual explanations that:

  • Comply with intuition: The generated counterfactuals often reflect understandable changes (e.g., color variations in shoes, adding glasses to a face).
  • Increase trustworthiness: By providing explanations that balance plausibility and adversarial power, users can better trust the model's outputs.
  • Uncover data biases: The framework successfully identified biases in datasets, such as the association of certain features with specific classes in the CelebA dataset.
  • Work across diverse tasks: The framework was tested on image and 3D data, showing its applicability to various classification problems. The audited models generally achieved high accuracy (over 94%), suggesting the counterfactuals highlight explanatory capabilities rather than model failures.

Limitations and Future Work

  • Computational Cost: The multi-objective optimization process can be computationally intensive.
  • Interpretability of Complex Data: While the framework works for image and 3D data, interpreting counterfactuals for even higher dimensional data (like video or multi-modal tasks) remains a challenge.
  • Future Work: The authors suggest extending the framework to handle more complex input/output dimensionalities and improving the understandability of counterfactuals based on cognitive feedback from users. They also aim to bring human cognitive skills more directly into the generation loop.

Summary updated

Abstract

There is a broad consensus on the importance of deep learning models in tasks involving complex data. Often, an adequate understanding of these models is required when focusing on the transparency of decisions in human-critical applications. Besides other explainability techniques, trustworthiness can be achieved by using counterfactuals, like the way a human becomes familiar with an unknown process: by understanding the hypothetical circumstances under which the output changes. In this work we argue that automated counterfactual generation should regard several aspects of the produced adversarial instances, not only their adversarial capability. To this end, we present a novel framework for the generation of counterfactual examples which formulates its goal as a multi-objective optimization problem balancing three different objectives: 1) plausibility, i.e., the likeliness of the counterfactual of being possible as per the distribution of the input data; 2) intensity of the changes to the original input; and 3) adversarial power, namely, the variability of the model's output induced by the counterfactual. The framework departs from a target model to be audited and uses a Generative Adversarial Network to model the distribution of input data, together with a multi-objective solver for the discovery of counterfactuals balancing among these objectives. The utility of the framework is showcased over six classification tasks comprising image and three-dimensional data. The experiments verify that the framework unveils counterfactuals that comply with intuition, increasing the trustworthiness of the user, and leading to further insights, such as the detection of bias and data misrepresentation.
BibTeX
@misc{ser2022exploring,
  author = {Javier Del Ser and Alejandro Barredo Arrieta and Natalia Díaz Rodríguez and Francisco Herrera and Andreas Holzinger},
  title = {{Exploring the Trade-off between Plausibility, Change Intensity and Adversarial Power in Counterfactual Explanations using Multi-objective Optimization}},
  year = {2022},
  eprint = {2205.10232},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2205.10232},
}
Figure