Reinforced Domain Selection for Continuous Domain Adaptation
Lists
Only you see this
Abstract
Continuous Domain Adaptation (CDA) effectively bridges significant domain shifts by progressively adapting from the source domain through intermediate domains to the target domain. However, selecting intermediate domains without explicit metadata remains a substantial challenge that has not been extensively explored in existing studies. To tackle this issue, we propose a novel framework that combines reinforcement learning with feature disentanglement to conduct domain path selection in an unsupervised CDA setting. Our approach introduces an innovative unsupervised reward mechanism that leverages the distances between latent domain embeddings to facilitate the identification of optimal transfer paths. Furthermore, by disentangling features, our method facilitates the calculation of unsupervised rewards using domain-specific features and promotes domain adaptation by aligning domain-invariant features. This integrated strategy is designed to simultaneously optimize transfer paths and target task performance, enhancing the effectiveness of domain adaptation processes. Extensive empirical evaluations on datasets such as Rotated MNIST and ADNI demonstrate substantial improvements in prediction accuracy and domain selection efficiency, establishing our method's superiority over traditional CDA approaches.
BibTeX
@inproceedings{liu2025reinforced,
author = {Hanbing Liu and Huaze Tang and Yanru Wu and Yang Li and Xiao-Ping Zhang},
title = {{Reinforced Domain Selection for Continuous Domain Adaptation}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2025},
}| Adapting to Continuously Shifting Domains | Workshops @ ICLR · 2018 |
| Deep Reinforcement Learning Boosted Partial Domain Adaptation | IJCAI · 2021 |
| Gradual Domain Adaptation without Indexed Intermediate Domains | arXiv · 2022 |
| Domain Adversarial Reinforcement Learning for Partial Domain Adaptation | arXiv · 2019 |
| Open Compound Domain Adaptation | CVPR · 2020 |
| Delving into the Continuous Domain Adaptation | ACM Multimedia · 2022 |