AudoFormer: An Efficient Transformer with Consistent Auxiliary Domain for Source-free Domain Adaptation
Its authors withdrew this paper, so there is no full text to read or summarize.
Lists
Only you see this
Abstract
Source-free domain adaptation (SFDA), which tackles domain adaptation without accessing the source domain directly, has gradually gained widespread attention. However, due to the inaccessibility of source domain data, deterministic invariable features cannot be obtained. Current advanced methods mainly evaluate pseudo-labels or consistent neighbor labels for self-supervision, which are susceptible to hard samples and affected by domain bias. In this paper, we propose an efficient transFormer with a consistent Auxiliary domain for source-free domain adaptation, abbreviated as AudoFormer, which solves the invariable feature representation from a new perspective by domain consistency. Concretely, AudoFormer constructs an auxiliary domain module (ADM) block, which can achieve diversified representations from the global attention feature in the intermediate layers. Then based on the auxiliary domain and target domain, we distinguish invariable feature representation by exploiting multiple consistency strategies, i.e., dynamically evaluated consistent labels and consistent neighbors, which can divide the whole target samples into source-like easy samples and target-specific hard samples. Finally, we align the source-like with the target-specific samples by conditional guided multi-kernel max mean discrepancy (CMK-MMD), which guides the hard samples to align the corresponding easy samples. To verify the effectiveness, we conduct extensive experiments on three benchmark datasets (i.e., Office-31, Office-Home, and VISDA-C). Results show that our approach achieves significant performance among multiple domain adaptation benchmarks compared to the other state-of-the-art baselines. Code will be available.
BibTeX
@misc{shao2024audoformer,
author = {Renrong Shao and Wei Zhang and Kangyang Luo and Qin Li and Jun Wang},
title = {{AudoFormer: An Efficient Transformer with Consistent Auxiliary Domain for Source-free Domain Adaptation}},
year = {2024},
url = {https://openreview.net/forum?id=xle26hcxHh},
howpublished = {OpenReview},
note = {Submitted to ICLR 2024},
}