Low-Sample Image Classification Based on Intrinsic Consistency Loss and Uncertainty Weighting Method
Lists
Only you see this
Abstract
As is well known, the classification performance of large deep neural networks is closely related to the amount of annotated data. However, in practical applications, the quantity of annotated data is minimal for many computer vision tasks, which poses a considerable challenge for deep convolutional neural networks that aim to achieve ideal classification performance. This paper proposes a new, fully supervised low-sample image classification model to alleviate the problem of limited marked sample quantity in real life. Specifically, this paper presents a new sample intrinsic consistency loss, which can more effectively update model parameters from a “fundamental” perspective by exploring the difference between intrinsic sample features and semantic information contained in sample labels. Secondly, a new uncertainty weighting method is proposed to weigh the original supervised loss. It can more effectively learn sample features by weighting sample losses one by one based on their classification status and help the model autonomously understand the importance of different local information. Finally, a sample generation model generates some artificial samples to supplement the limited quantity of actual training samples. The model adjusts parameters through the combined effect of sample intrinsic consistency loss and weighted supervised loss. This paper uses <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$25 \%$ </tex-math></inline-formula> of the SVHN dataset and <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$30 \%$ </tex-math></inline-formula> of the CIFAR-10 dataset as training samples to simulate scenarios with limited sample quantities in real life, achieving accuracies of <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$94.59 \%$ </tex-math></inline-formula> and <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$91.27 \%$ </tex-math></inline-formula> respectively, demonstrating the effectiveness of our method on small real datasets.
BibTeX
@inproceedings{li2023low,
author = {Zhiguo Li and Lingbo Li and Xi Xiao and Jinpeng Chen and Nawei Zhang and Sai Li},
title = {{Low-Sample Image Classification Based on Intrinsic Consistency Loss and Uncertainty Weighting Method}},
booktitle = {IEEE Access},
year = {2023},
doi = {10.1109/access.2023.3276875},
}Loading related content...