Abstract
Explainable AI (XAI) is crucial for high-stakes applications like autonomous driving, yet most research focuses on visible-light classification. This study evaluates three saliency map generators—Grad-CAM, RISE, and SIDU—on multispectral object detection tasks. By analyzing performance across RGB and various infrared spectra, the research demonstrates that multi-modal training and infrared data lead to more precise, interpretable model explanations.
Introduction
Deep learning models are often criticized as "black boxes," making it difficult to understand the reasoning behind their predictions. In multispectral object detection, where models process both visible (RGB) and infrared (IR) data, transparency is vital for safety. This paper addresses the gap in XAI research by systematically comparing saliency methods in complex, multi-modal environments.
Methodology
The study evaluates three distinct saliency map generators adapted for the EfficientDet-D0 object detector:
- Grad-CAM (Gradient-weighted Class Activation Mapping): A gradient-based method that is computationally efficient but often less precise.
- RISE (Randomized Input Sampling for Explanation): A perturbation-based method that randomly masks input regions. It is highly precise but computationally expensive.
- SIDU (Similarity Difference and Uniqueness): A newer approach that uses internal feature maps as masks to calculate regional contributions.
Datasets and Multispectral Analysis
The researchers utilized the Multispectral Object Detection Dataset, featuring synchronized scenes in RGB, Near-Infrared (NIR), Mid-wave Infrared (MIR), and Far-Infrared (FIR/Thermal). A key finding was that saliency maps for infrared spectra tend to be more focused on the actual object than RGB maps, likely due to the high contrast of heat signatures.
Key Insights
- Multi-modal Synergy: Training on combined RGB and MIR data significantly improves explanation quality, resulting in tighter maps with less background noise compared to single-spectrum models.
- Computational Trade-offs: There is a massive disparity in speed. Grad-CAM offers near real-time performance (0.1s), whereas RISE requires 32s per image, making Grad-CAM the only viable choice for real-time applications like moving vehicles.
Results
Performance was quantified using Deletion and Insertion metrics. SIDU achieved the best (lowest) deletion score of 0.10 ± 0.03 when used with NIR data. Furthermore, the combination of SIDU and RGB+MIR data yielded the highest insertion score (0.67 ± 0.21), indicating it most accurately identified the pixels that drive model confidence.
Conclusion
While SIDU and RISE provide more mathematically robust and precise explanations, their high computational cost remains a barrier for real-time deployment. Future work should focus on optimizing these perturbation-based methods and extending evaluations to spatio-temporal (video) and 3D volumetric data.
Summary updated