Implicit Differentiable Outlier Detection Enable Robust Deep Multimodal Analysis

Zhu Wang, Sourav Medya, Sathya N. RaviNeurIPS 2023 · OpenReview

Presented at NeurIPS 2023, this paper introduces an innovative approach to making multimodal deep learning more robust and efficient. By integrating an "implicit" layer to filter out noisy data, the authors address the computational and performance bottlenecks of large-scale vision-language models.

TL;DR

The authors propose an implicit differentiable Out-of-Distribution (OOD) detection layer designed to filter noisy external knowledge in vision-language models. By framing outlier detection as a fixed-point problem and utilizing Jacobian-free backpropagation, they achieve state-of-the-art performance on reasoning tasks with significantly lower memory consumption and training time.

The Challenge of External Knowledge

Modern vision-language models are incredibly powerful but often lack "common sense" or deep reasoning capabilities. To bridge this gap, researchers frequently augment them with external knowledge from sources like Knowledge Graphs (e.g., ConceptNet).

However, this integration introduces two major hurdles:

  1. The Noise Problem: External knowledge retrieval is inherently messy. Searching for a "street" might return "fire hydrant" as a related concept. If there is no fire hydrant in the actual image, this "knowledge" becomes distracting noise that degrades training.
  2. The Efficiency Problem: Filtering this noise in a differentiable way—so the model can learn from it—usually requires "unrolling" iterative algorithms. This process consumes massive amounts of GPU memory and time.

Methods: The VK-OOD Architecture

To solve these issues, the authors introduce VK-OOD, an architecture that leverages an implicit layer to handle outlier detection efficiently.

  • Implicit OOD Layer: Instead of a standard fixed-sequence layer, the model uses a Gaussian Mixture Model (GMM) to approximate the density of "in-distribution" features. The GMM parameters are solved using the Expectation-Maximization (EM) algorithm.
  • Fixed-Point Iteration: The EM algorithm is treated as a fixed-point iteration. In deep learning, an "implicit" layer means the network only requires the final result of this iteration, rather than tracking every intermediate step.
  • Jacobian-Free Backpropagation (JFB): This is the core efficiency breakthrough. Standard backpropagation through an iterative solver is highly memory-intensive. JFB allows the model to compute gradients at the fixed point without storing the solver's entire trajectory.
  • GEM Score: An energy-based function called the "GEM score" is used to identify which pieces of external knowledge are outliers relative to the image and text.
VK-OOD Architecture

Datasets and Evaluation

The model was pre-trained on a combination of COCO, Visual Genome, and SBU Captions (totaling roughly 4 million images). It was subsequently evaluated on several downstream benchmarks:

  • VQAv2 & OKVQA: Visual Question Answering (OKVQA specifically requires external knowledge).
  • NLVR2: Natural Language Visual Reasoning.
  • Flickr30k & COCO: Image-text retrieval tasks.

Key Insights and Ideas

  • "Benign" Noise Management: The paper argues that perfectly removing all noise is unnecessary. Instead, a differentiable method to "downweight" noise during training is sufficient for the model to focus on relevant features.
  • Implicit is Efficient: By utilizing implicit layers, the authors decoupled the complexity of outlier detection from the memory cost of training. The model converges quickly, and the accuracy gains from more iterations ($T$) eventually plateau, proving the efficiency of the solver.
  • Knowledge Alignment: The OOD layer acts as a gatekeeper, ensuring that external knowledge triplets (e.g., <zebra, locate in, zoo>) align with the visual evidence in the image before being used for reasoning.
Ablation Studies on Iterations and Convergence

Key Results

  • Massive Speedup: Compared to "vanilla" unrolling of the EM algorithm, the Jacobian-Free (JFB-EM) approach reduced the backward pass time from 26.8 minutes to 6.3 minutes per epoch—a 4x speedup.
  • Memory Savings: Maximum memory usage dropped from ~18.7 GB to ~13.7 GB, making it significantly easier to train on standard hardware.
  • Competitive Accuracy: On the notoriously difficult OKVQA dataset, the model achieved 52.4% accuracy, outperforming several much larger state-of-the-art models.

Limitations and Future Work

  • Dense Covariance: The current implementation uses dense covariance matrices in the GMM. For very high-dimensional data, this could become a bottleneck. The authors suggest exploring sparse approaches in future iterations.
  • Upstream Gradients: The current work focuses on backpropagating through the OOD layer to immediate upstream layers. Extending this to propagate through the entire vision/language backbone could yield further gains.
  • Domain Expansion: The authors believe this framework would be particularly useful in specialized fields like medical imaging, where high-quality but noisy domain-specific knowledge graphs are common.

Summary updated

Abstract

Deep network models are often purely inductive during both training and inference on unseen data. When these models are used for prediction, but they may fail to capture important semantic information and implicit dependencies within datasets. Recent advancements have shown that combining multiple modalities in large-scale vision and language settings can improve understanding and generalization performance. However, as the model size increases, fine-tuning and deployment become computationally expensive, even for a small number of downstream tasks. Moreover, it is still unclear how domain or prior modal knowledge can be specified in a backpropagation friendly manner, especially in large-scale and noisy settings. To address these challenges, we propose a simplified alternative of combining features from pretrained deep networks and freely available semantic explicit knowledge. In order to remove irrelevant explicit knowledge that does not correspond well to the images, we introduce an implicit Differentiable Out-of-Distribution (OOD) detection layer. This layer addresses outlier detection by solving for fixed points of a differentiable function and using the last iterate of fixed point solver to backpropagate. In practice, we apply our model on several vision and language downstream tasks including visual question answering, visual reasoning, and image-text retrieval on different datasets. Our experiments show that it is possible to design models that perform similarly to state-of-the-art results but with significantly fewer samples and less training time. Our models and code are available here: https://github.com/ellenzhuwang/implicit_vkood
BibTeX
@inproceedings{wang2023implicit,
  author = {Zhu Wang and Sourav Medya and Sathya N. Ravi},
  title = {{Implicit Differentiable Outlier Detection Enable Robust Deep Multimodal Analysis}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2023},
  url = {https://openreview.net/forum?id=jooPcatnVF},
}
Figure