Towards Interpretable Object Detection by Unfolding Latent Structures

Tianfu Wu, Xi Song

Abstract

Deep learning models for object detection often operate as "black boxes," providing high accuracy but little insight into their decision-making process. This paper introduces the AOGParsing operator, which integrates hierarchical AND-OR Graphs (AOGs) into the R-CNN framework. By unfolding latent structures of objects into parse trees, the model provides visual rationales for its detections without requiring part-level supervision. Experimental results on PASCAL VOC and COCO datasets demonstrate that this structural interpretability is achieved without compromising detection performance.

Introduction

While deep neural networks have achieved human-level accuracy in object detection, they are notoriously difficult to interpret. A standard Faster R-CNN might correctly identify a "cat," but the decision is made within a "flat" fully-connected layer that pools features into a single, uninterpretable vector. This lack of transparency is problematic in high-stakes environments like autonomous driving or medical imaging, where understanding the basis of a model's prediction is crucial. Existing interpretability methods are often post-hoc or produce blurry heatmaps. This research aims to build interpretability directly into the architecture by forcing the model to represent objects as structured hierarchies of parts.

Methodology: The AOGParsing Operator

The core innovation is the AOGParsing operator, integrated into the two-stage R-CNN framework. Instead of a standard flat layer, the authors use a top-down grammar model known as an AND-OR Graph (AOG).

The hierarchical structure of an AND-OR Graph (AOG) used to represent object parts and configurations.

Structural Components

  • AND-nodes represent the decomposition of a large part into smaller ones (e.g., a car is composed of a body and wheels).
  • OR-nodes represent alternative configurations or viewpoints (e.g., a car seen from the front vs. the side).
  • Terminal-nodes correspond to specific feature maps for localized regions.

Learning and Inference

Crucially, the model is trained under weak supervision; it is not given labels for "wheels" or "heads." It learns to "unfold" these latent structures automatically using only standard bounding box and category labels. A Value Sub-network acts as an attention mechanism, weighting different part configurations based on their discriminative power. To ensure robust learning, a Folding-Unfolding Strategy is employed: the model first trains all parts equally ("folding") before allowing it to select the best structural explanation ("unfolding").

Experimental Results

The authors evaluated their method on two gold-standard benchmarks: PASCAL VOC 2007 and COCO 2017.

Performance and Interpretability

One of the most significant findings is that structural interpretability does not come at the cost of performance. On PASCAL VOC 2007, the method achieved a Mean Average Precision (mAP) of 82.1%, identical to the baseline Faster R-CNN. On the more challenging COCO dataset, it achieved a Box AP of 38.2%, remaining competitive with state-of-the-art black-box models.

Qualitative examples of object detection where the model "unfolds" the latent structure to provide a visual rationale for its predictions.

The "best parse tree" selected by the model serves as a qualitative explanation. As shown in the visualizations, the model correctly identifies the layouts of various objects, effectively justifying its bounding boxes with structural evidence.

Conclusion and Future Work

By using a hierarchical grammar as an inductive bias, the researchers provide the model with a prior about the world's structure—that objects are composed of parts. While the results are promising, quantifying interpretability remains a challenge. Future work may involve developing "interpretability-sensitive" loss functions and optimizing the computational efficiency of the parsing process for real-time applications. Additionally, moving from predefined AOG structures to learning the grammar itself represents a significant future direction.

Summary updated

Abstract

This paper first proposes a method of formulating model interpretability in visual understanding tasks based on the idea of unfolding latent structures. It then presents a case study in object detection using popular two-stage region-based convolutional network (i.e., R-CNN) detection systems. The proposed method focuses on weakly-supervised extractive rationale generation, that is learning to unfold latent discriminative part configurations of object instances automatically and simultaneously in detection without using any supervision for part configurations. It utilizes a top-down hierarchical and compositional grammar model embedded in a directed acyclic AND-OR Graph (AOG) to explore and unfold the space of latent part configurations of regions of interest (RoIs). It presents an AOGParsing operator that seamlessly integrates with the RoIPooling/RoIAlign operator widely used in R-CNN and is trained end-to-end. In object detection, a bounding box is interpreted by the best parse tree derived from the AOG on-the-fly, which is treated as the qualitatively extractive rationale generated for interpreting detection. In experiments, Faster R-CNN is used to test the proposed method on the PASCAL VOC 2007 and the COCO 2017 object detection datasets. The experimental results show that the proposed method can compute promising latent structures without hurting the performance. The code and pretrained models are available at https://github.com/iVMCL/iRCNN.
BibTeX
@inproceedings{wu2019towards,
  author = {Tianfu Wu and Xi Song},
  title = {{Towards Interpretable Object Detection by Unfolding Latent Structures}},
  booktitle = {IEEE/CVF International Conference on Computer Vision},
  year = {2019},
  doi = {10.1109/iccv.2019.00613},
}
Figure