Energy-based Self-Training and Normalization for Unsupervised Domain Adaptation
Lists
Only you see this
Abstract
We propose an Unsupervised Domain Adaptation (UDA) method by making use of Energy-Based Learning (EBL) and demonstrate 1. EBL can be used to improve the instance selection for a self-training task on the unlabelled target domain, and 2. alignment and normalizing energy scores can learn domain-invariant representations. For the former, we show that an energy-based selection criterion can be used to model instance selections by mimicking the joint distribution between data and predictions in the target domain. As per learning domain invariant representations, we show that stable domain alignment can be achieved by a combined energy alignment and an energy normalization process. We implement our method in consistent with the vision-transformer (ViT) backbone and show that our proposed method can outperform state-of-the-art ViT based UDA methods on diverse benchmarks (DomainNet, Office-Home, and VISDA2017).
BibTeX
@inproceedings{herath2023energy,
author = {Samitha Herath and Basura Fernando and Ehsan Abbasnejad and Munawar Hayat and Shahram Khadivi and Mehrtash Harandi and Hamid Rezatofighi and Gholamreza Haffari},
title = {{Energy-based Self-Training and Normalization for Unsupervised Domain Adaptation}},
booktitle = {IEEE/CVF International Conference on Computer Vision},
year = {2023},
doi = {10.1109/iccv51070.2023.01070},
}Loading related content...