Adaptive integrated weight unsupervised multi-source domain adaptation without source data

Z.g. Wang, Yang Liu, Yahong HanComplex 2025 · DOI

Abstract

Unsupervised multi-source domain adaptation (UMDA) transfers knowledge from multiple labeled source domains to an unlabeled target domain. Traditional UMDA assumes direct access to source data, raising significant privacy concerns. This paper introduces Trust center sample-based Source-free Domain Adaptation (TSDA), a method that operates without source data by leveraging pre-trained source models. TSDA identifies high-confidence "trust center samples" in the target domain and employs a self-supervised pseudo-labeling strategy. By adaptively weighting source-specific target models, TSDA achieves state-of-the-art performance on benchmark datasets and demonstrates superior robustness against adversarial perturbations.

Introduction

Unsupervised Multi-source Domain Adaptation (UMDA) is critical for deploying models across diverse environments. However, the requirement for concurrent access to source and target data is often impractical due to data privacy regulations, massive data volumes, or proprietary restrictions. Source-free UMDA addresses these challenges by adapting pre-trained source models to a target domain without ever seeing the original source data. The primary hurdle is aligning distributions and correcting domain shifts in the absence of source samples.

Methodology: The TSDA Framework

The proposed TSDA method follows a multi-stage pipeline to bridge the domain gap without source data.

Overview of the TSDA framework showing source model acquisition, pseudo-label assignment, and weighted integration.

1. Source Model Acquisition and Initialization

Models are first pre-trained on multiple distinct source domains using standard cross-entropy loss. These models serve as the starting point for adaptation, providing initial feature extractors ($F^i$) and classifiers ($C^i$).

2. Trust Center Sample Selection

To handle the unlabeled target data, TSDA uses an entropy function to measure prediction uncertainty. Samples with the lowest entropy—representing the highest model confidence—are designated as "trust centers" for each class. These centers act as reliable anchors for the target domain's feature space.

3. Self-Supervised Pseudo-Labeling

Instead of using raw model predictions which can be noisy, TSDA assigns pseudo-labels to target samples based on their cosine similarity to the identified trust centers. This stabilizes the learning process and provides a cleaner supervisory signal.

4. Adaptive Weight Integration

Not all source domains are equally relevant to the target. TSDA employs a multi-layer perceptron (MLP) to calculate contribution weights for each source model. This allows the system to prioritize knowledge from source domains that are most similar to the target.

Conceptual illustration of how different source domains contribute varying weights to the target domain adaptation.

5. Robust Optimization

The target model is optimized using a composite loss function:

  • Information Maximization ($L_{ent} + L_{div}$): Minimizes uncertainty while ensuring class diversity in predictions.
  • Classification Loss ($L_{cls}$): Trains the model using the refined pseudo-labels.

Experimental Evaluation

TSDA was evaluated on several standard benchmarks: Office-Home, Office-Caltech10, and Office31. Additionally, the researchers tested robustness using adversarial samples generated via Projected Gradient Descent (PGD).

Key Results

  • State-of-the-Art Accuracy: TSDA achieved an average accuracy of 98.0% on Office-Caltech10, surpassing both source-free and source-dependent baselines.
  • Adversarial Robustness: TSDA showed remarkable resilience. Under 100% target data perturbation on the Office-Home dataset, TSDA maintained 54.1% accuracy, outperforming methods like ATEN (53.5%) and DECISION (51.8%).
  • Effective Source Weighting: The adaptive mechanism correctly identified domain similarities, such as the high relevance of "Webcam" data when the target is "DSLR".

Discussion and Insights

A significant finding is that TSDA often outperforms traditional UMDA methods that have full access to source data. This suggests that the source-free constraint may act as a regularizer, encouraging the model to learn more robust, domain-invariant features directly from the target distribution. By filtering for "trust centers" first, the model avoids the error propagation common in standard pseudo-labeling approaches.

However, the current reliance on a single trust center per class may be a limitation for datasets with high intra-class variance. Future work will explore multi-center selection strategies and extending the framework to natural language processing tasks.

Conclusion

TSDA provides a powerful, privacy-preserving solution for multi-source domain adaptation. By combining entropy-based sample selection with adaptive model weighting, it achieves superior performance and robustness without the need for sensitive source data.

Summary updated

Abstract

Unsupervised multi-source domain adaptation methods transfer knowledge learned from multiple labeled source domains to an unlabeled target domain. Existing methods assume that all source domain data can be accessed directly. However, such an assumption is unrealistic and causes data privacy concerns, especially when the source domain labels include personal information. In such a setting, it is prohibited to minimize domain gaps by pairwise calculation of the data from the source and target domains. Therefore, this work addresses the source-free unsupervised multi-source domain adaptation problem, where only the source models are available during the adaptation. We propose trust center sample-based source-free domain adaptation (TSDA) method to solve this problem. The key idea is to leverage the pre-trained models from the source domain and progressively train the target model in a self-learning manner. Because target samples with low entropy measured from the pre-trained source model achieve high accuracy, the trust center samples are selected first using the entropy function. Then pseudo labels are assigned for target samples based on a self-supervised pseudo-labeling strategy. For multiple source domains, corresponding target models are learned based on the assigned pseudo labels. Finally, multiple target models are integrated to predict the label for unlabeled target data. Extensive experiment results on some benchmark datasets and generated adversarial samples demonstrate that our approach outperforms existing UMDA methods, even though some methods can always access source data.
BibTeX
@inproceedings{wang2025adaptive,
  author = {Z.G. Wang and Yang Liu and Yahong Han},
  title = {{Adaptive integrated weight unsupervised multi-source domain adaptation without source data}},
  booktitle = {Complex},
  year = {2025},
  doi = {10.1007/s40747-025-01871-3},
}
Figure