Provably Robust Detection of Out-of-distribution Data (almost) for free
Lists
Only you see this
Abstract
The application of machine learning in safety-critical systems requires a reliable assessment of uncertainy. However, deep neural networks are known to produce highly overconfident predictions on out-of-distribution (OOD) data. Even if trained to be non-confident on OOD data one can still adversarially manipulate OOD data so that the classifier again assigns high confidence to the manipulated samples. In this paper we propose a novel method that combines a certifiable OOD detector with a standard classifier from first principles into an OOD aware classifier. This way we achieve the best of two worlds: certifiably adversarially robust OOD detection, even for OOD samples close to the in-distribution, without loss in either prediction accuracy or detection performance for non-manipulated OOD data. Moreover, due to the particular construction our classifier provably avoids the asymptotic overconfidence problem of standard neural networks.
BibTeX
@inproceedings{meinke2022provably,
author = {Alexander Meinke and Julian Bitterwolf and Matthias Hein},
title = {{Provably Robust Detection of Out-of-distribution Data (almost) for free}},
booktitle = {Advances in Neural Information Processing Systems},
year = {2022},
url = {https://openreview.net/forum?id=YfU5WTpv97},
}Loading related content...