MoreauGrad: Sparse and Robust Interpretation of Neural Networks via Moreau Envelope

Jingwei Zhang, Farzan Farnia

Introduction

Deep Neural Networks (DNNs) have achieved state-of-the-art performance across various domains, yet they remain largely "black boxes." To demystify their decision-making processes, researchers utilize saliency maps—visualizations that highlight the input features, such as specific pixels in an image, that most significantly influence a model's prediction. However, traditional gradient-based saliency methods, including Simple Gradient and Integrated Gradients, face two primary hurdles: a lack of robustness to noise and the production of visually cluttered, "dense" maps that highlight irrelevant background information.

This paper introduces MoreauGrad, a framework designed to produce interpretations that are both mathematically robust and visually sparse. By leveraging the Moreau envelope from optimization theory, MoreauGrad transforms the explanation process into a smooth optimization problem, offering a more reliable and interpretable alternative to existing techniques.

The MoreauGrad Framework

The fundamental innovation of MoreauGrad lies in defining the interpretation as the gradient of the Moreau envelope of the classifier's score function.

Smoothing via Optimization

In traditional optimization, the Moreau envelope is a technique used to smooth non-smooth functions. Unlike methods like SmoothGrad, which rely on Monte Carlo sampling (averaging gradients over noisy versions of the input), MoreauGrad employs a deterministic optimization approach. By solving a proximal optimization problem, it identifies a nearby point in the input space that represents a smoothed version of the local loss landscape.

Theoretical Guarantees

One of the significant contributions of this work is the application of "weak convexity" to neural networks. The authors prove that if the underlying model function is weakly convex—a property shared by many common architectures—the resulting MoreauGrad is guaranteed to be Lipschitz continuous. This mathematical guarantee ensures that the explanation remains stable and does not change drastically when the input is subjected to minor perturbations.

Sparsity as a Prior

Because MoreauGrad is built on an optimization framework, it allows for the seamless integration of regularization terms. The authors introduce two specific extensions:

  1. Sparse MoreauGrad: Incorporates an $L_1$ penalty to produce clean maps that highlight only the most critical pixels.
  2. Group-Sparse MoreauGrad: Utilizes a group-norm penalty to highlight clusters of related pixels, effectively identifying entire object components rather than isolated points.

This approach treats sparsity not merely as a visual preference but as a "prior condition," reflecting the reality that in most classification tasks, only a small subset of features (e.g., the beak of a bird) should drive the final label.

Experimental Methodology

The authors evaluated MoreauGrad against standard computer vision benchmarks and architectures:

  • CIFAR-10: Tested using a ResNet-18 architecture.
  • ImageNet-1K: Evaluated using a pre-trained EfficientNet-b0.
  • Tiny-ImageNet: Used for additional robustness and sensitivity testing.

The method was implemented using Proximal Gradient Descent, ensuring that the computation of the envelopes remains practical for modern, deep architectures.

Key Results and Insights

Visual Clarity and Interpretability

Qualitative analysis demonstrates that Sparse MoreauGrad produces significantly cleaner saliency maps than baseline methods. It effectively filters out background noise, leaving sharp, recognizable features—such as the structural components of a chainsaw or the facial features of a dog—that align with human intuition.

Quantitative Robustness

To measure robustness, the authors utilized metrics such as Structural Similarity (SSIM) and Top-k Intersection. MoreauGrad consistently outperformed Simple Gradient and Integrated Gradients, maintaining high similarity to original maps even when the input images were subjected to adversarial attacks. While baseline methods often degraded into unrecognizable noise under perturbation, MoreauGrad's interpretations remained stable.

Limitations and Future Directions

Despite its advantages, MoreauGrad introduces certain trade-offs:

  • Computational Cost: Because it requires an iterative optimization process (Proximal Gradient Descent) for each explanation, it is more computationally intensive than single-pass gradient methods.
  • Hyperparameter Sensitivity: The framework introduces parameters such as $\rho$ (for smoothing) and $\eta$ (for sparsity). While the authors provide general guidelines, optimal settings may vary depending on the specific model or dataset.

Future research may explore the transferability of these interpretations across different model architectures and the application of 1-norm-based Moreau envelope theory to other facets of deep learning beyond interpretability.

Summary updated

Abstract

Explaining the predictions of deep neural nets has been a topic of great interest in the computer vision literature. While several gradient-based interpretation schemes have been proposed to reveal the influential variables in a neural net's prediction, standard gradient-based interpretation frameworks have been commonly observed to lack robustness to input perturbations and flexibility for incorporating prior knowledge of sparsity and group-sparsity structures. In this work, we propose MoreauGrad as an interpretation scheme based on the classifier neural net's Moreau envelope. We demonstrate that MoreauGrad results in a smooth and robust interpretation of a multi-layer neural network and can be efficiently computed through first-order optimization methods. Furthermore, we show that MoreauGrad can be naturally combined with $L_1$-norm regularization techniques to output a sparse or group-sparse explanation which are prior conditions applicable to a wide range of deep learning applications. We empirically evaluate the proposed MoreauGrad scheme on standard computer vision datasets, showing the qualitative and quantitative success of the MoreauGrad approach in comparison to standard gradient-based interpretation methods.
BibTeX
@inproceedings{zhang2023moreaugrad,
  author = {Jingwei Zhang and Farzan Farnia},
  title = {{MoreauGrad: Sparse and Robust Interpretation of Neural Networks via Moreau Envelope}},
  booktitle = {IEEE/CVF International Conference on Computer Vision},
  year = {2023},
}
Figure