Is Disentanglement all you need? Comparing Concept-based & Disentanglement Approaches

Dmitry Kazhdan, Botty Dimanov, Helena Andrés-Terré, Mateja Jamnik, Pietro Liò, Adrian WellerarXiv 2021 · arXiv

In the pursuit of interpretable deep learning, two primary paradigms have emerged: Concept-Based Explanations and Disentanglement Learning. While both aim to decompose complex data into human-understandable units, they have largely developed in isolation. This paper provides a systematic comparison between these approaches, evaluating their data efficiency, task dependency, and robustness to feature variance.

The Interpretability Gap

Deep learning models are often criticized for being "black boxes." Researchers have proposed two main solutions:

  1. Concept-Based Models (CBMs): These models are explicitly trained to identify human-defined concepts (e.g., "shape," "color") as an intermediate step before final prediction.
  2. Disentanglement (VAEs): Generative models, such as Variational Autoencoders, attempt to automatically discover independent latent factors of variation without explicit human labels.

This study investigates whether these methods are truly interchangeable and identifies the inherent trade-offs in each approach using benchmark datasets like dSprites and shapes3D.

Data Efficiency and the Labeling Burden

A significant hurdle for both paradigms is the requirement for annotated data. While unsupervised VAEs exist, achieving reliable interpretability often requires weak supervision (WVAEs). The authors find that both CBMs and WVAEs are surprisingly data-hungry.

Data efficiency comparison between CBM and WVAE on shapes3d and dSprites datasets.

As shown in Figure 1, CBMs generally demonstrate higher data efficiency than WVAEs. This is because CBMs are directly optimized for concept identification, whereas WVAEs must balance disentanglement with a reconstruction loss. To achieve even moderate concept accuracy (e.g., 60%), these models often require up to 40% of the dataset to be manually labeled.

Concept "Loudness" and Variance Bias

One of the paper's most critical insights is the concept of "loudness." Generative models like VAEs are naturally biased toward features that cause the highest variance in raw pixel values, such as object position or large-scale color changes. These are termed "loud" concepts.

Concept accuracies across different spatial variance setups, highlighting the 'loudness' bias in WVAEs compared to supervised CBMs.

In Figure 5, we observe that WVAEs struggle to capture "quiet" concepts (like subtle rotations) when "loud" concepts (like spatial position) are present. In contrast, CBMs remain robust to this variance because their supervision forces the model to attend to all defined concepts regardless of their pixel-level impact. This "variance fragility" suggests that unsupervised methods may systematically ignore subtle but important attributes.

Task Dependency and Extraction Limits

The study also examines Post-hoc Concept Extraction (CME), where researchers attempt to find concepts within a pre-trained model. The results indicate a "Task-Dependency Trap": if the original model was trained on a task that did not require a specific concept, that concept is effectively lost. You cannot extract information that the model never learned to represent. Accuracy in concept extraction drops significantly as the end-task becomes less dependent on those specific features.

Conclusion

The comparison reveals that "interpretable" does not always mean "reliable." While CBMs offer better data efficiency and robustness to feature variance, they require heavy supervision. Disentanglement methods offer a path toward discovery but are currently limited by a bias toward high-variance features. Future work must address these trade-offs to build models that are both interpretable and practical for complex, real-world applications.

Summary updated

Abstract

Concept-based explanations have emerged as a popular way of extracting human-interpretable representations from deep discriminative models. At the same time, the disentanglement learning literature has focused on extracting similar representations in an unsupervised or weakly-supervised way, using deep generative models. Despite the overlapping goals and potential synergies, to our knowledge, there has not yet been a systematic comparison of the limitations and trade-offs between concept-based explanations and disentanglement approaches. In this paper, we give an overview of these fields, comparing and contrasting their properties and behaviours on a diverse set of tasks, and highlighting their potential strengths and limitations. In particular, we demonstrate that state-of-the-art approaches from both classes can be data inefficient, sensitive to the specific nature of the classification/regression task, or sensitive to the employed concept representation.
BibTeX
@misc{kazhdan2021is,
  author = {Dmitry Kazhdan and Botty Dimanov and Helena Andrés-Terré and Mateja Jamnik and Pietro Liò and Adrian Weller},
  title = {{Is Disentanglement all you need? Comparing Concept-based \& Disentanglement Approaches}},
  year = {2021},
  eprint = {2104.06917},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2104.06917},
}
Figure