Domain Generalization via Feature Variation Decorrelation

Chang Liu, Lichen Wang, Kai Li, Yun Fu

Abstract

Domain generalization aims to learn a model that generalizes to unseen target domains from multiple source domains. Various approaches have been proposed to address this problem by adversarial learning, meta-learning, and data augmentation. However, those methods have no guarantee for target domain generalization. Motivated by an observation that the class-irrelevant information of sample in the form of semantic variation would lead to negative transfer, we propose to linearly disentangle the variation out of sample in feature space and impose a novel class decorrelation regularization on the feature variation. By doing so, the model would focus on the high-level categorical concept for model prediction while ignoring the misleading clue from other variations (including domain changes). As a result, we achieve state-of-the-art performances over all of widely used domain generalization benchmarks, namely PACS, VLCS, Office-Home, and Digits-DG with large margins. Further analysis reveals our method could learn a better domain-invariant representation, and decorrelated feature variation could successfully capture semantic meaning.
BibTeX
@inproceedings{liu2021domain,
  author = {Chang Liu and Lichen Wang and Kai Li and Yun Fu},
  title = {{Domain Generalization via Feature Variation Decorrelation}},
  booktitle = {ACM Multimedia},
  year = {2021},
  doi = {10.1145/3474085.3475311},
}

Loading related content...

Figure