How Image Corruption and Perturbation Affect Out-of-Distribution Generalization and Calibration
Lists
Only you see this
Abstract
In scenarios such as people-flow analysis and autonomous driving using camera footage, the performance of deep neural networks can be impacted by environmental changes such as the degradation of the camera lenses over time and changes in weather conditions. Understanding the impact of environmental changes on model performance is critical to the safe use of the model but has not been systematically investigated. In this study, we cast environmental changes as distribution shifts in the data and tackle the out-of-distribution generalization problem. In particular, we investigate the impact of performance degradation and uncertainty estimation under more than 30 distribution shifts considered in real-world applications. Our experimental results show that there is a correlation between classification accuracy and uncertainty in out-of-distribution environments. Furthermore, it is suggested that uncertainty calibration is not necessarily effective in environments where severe corruption occurs. We believe these findings will contribute to the safe use of the model in the real world.
BibTeX
@inproceedings{tada2023how,
author = {Keigo Tada and Hiroki Naganuma},
title = {{How Image Corruption and Perturbation Affect Out-of-Distribution Generalization and Calibration}},
booktitle = {IJCNN},
year = {2023},
doi = {10.1109/ijcnn54540.2023.10191806},
}Loading related content...