Self-Paced Augmentations (SPAug) for Improving Model Robustness
Lists
Only you see this
Abstract
Augmentations are crucial components in modern computer vision. While various augmentation techniques have been devised to enhance model generalization and robustness, they are conventionally applied uniformly to all dataset samples during training. In this paper, we introduce ``Self-Paced Augmentations (SPAug),'' a novel approach that dynamically adjusts the augmentation intensity for each sample based on its training statistics. Our approach incurs little to no computational overhead and can be effortlessly integrated with existing augmentation policies with just a few lines of code. We integrate our self-paced augmentations into established uniform augmentation policies such as AugMix, RandomAugment, and AutoAugment. Our experiments reveal sizeable improvements, with about 1\% enhancement on CIFAR10-C and CIFAR100-C datasets and a 1.81\% improvement on ImageNet-C over AugMix, all while maintaining the same natural accuracy. Furthermore, within the context of augmentations designed to enhance model generalization, we demonstrate a 0.4\% improvement over AutoAugment on CIFAR100, coupled with a 0.7\% enhancement in model robustness.
BibTeX
@misc{bandara2024self,
author = {Wele Gedara Chaminda Bandara and Amin Ghiasi and Vishwanath S and Ali Shafahi and Reza Ardekani},
title = {{Self-Paced Augmentations (SPAug) for Improving Model Robustness}},
year = {2024},
url = {https://openreview.net/forum?id=wPq7fkzL2j},
howpublished = {OpenReview},
note = {Submitted to ICLR 2024},
}Loading related content...