Domain-Agnostic Crowd Counting via Uncertainty-Guided Style Diversity Augmentation

Guanchen Ding, Lingbo Liu, Zhenzhong Chen, Changwen Chen

Abstract

Domain shift poses a significant barrier to the performance of crowd counting algorithms in unseen domains. While domain adaptation methods address this challenge by utilizing images from the target domain, they become impractical when target domain images acquisition is problematic. Additionally, these methods require extra training time due to the need for fine-tuning on target domain images. To tackle this problem, we propose an Uncertainty-Guided Style Diversity Augmentation (UGSDA) method, enabling the crowd counting models to be trained solely on the source domain and directly generalized to different unseen target domains. It is achieved by generating sufficiently diverse and realistic samples during the training process. Specifically, our UGSDA method incorporates three tailor-designed components: the Global Styling Elements Extraction (GSEE) module, the Local Uncertainty Perturbations (LUP) module, and the Density Distribution Consistency (DDC) loss. The GSEE extracts global style elements from the feature space of the whole source domain. The LUP aims to obtain uncertainty perturbations from the batch-level input to form style distributions beyond the source domain, which used to generate diversified stylized samples together with global style elements. To regulate the extent of perturbations, the DDC loss imposes constraints between the source samples and the stylized samples, ensuring the stylized samples maintain a higher degree of realism and reliability. Comprehensive experiments validate the superiority of our approach, demonstrating its strong generalization capabilities across various datasets and models. Our code will be made publicly available.
BibTeX
@inproceedings{ding2024domain,
  author = {Guanchen Ding and Lingbo Liu and Zhenzhong Chen and Changwen Chen},
  title = {{Domain-Agnostic Crowd Counting via Uncertainty-Guided Style Diversity Augmentation}},
  booktitle = {ACM Multimedia},
  year = {2024},
  doi = {10.1145/3664647.3681310},
}

Loading related content...

Figure