Domain Adaptation Without Source Data

15 concepts17 papers1 proposal

Deep learning models are notoriously brittle when deployed in environments that differ from their training data. Traditionally, Unsupervised Domain Adaptation (UDA) solves this problem by training on a labeled source dataset and an unlabeled target dataset simultaneously. However, as highlighted by Peng Su et al. in Adapting Object Detectors with Conditional Domain Normalization and Jogendra Nath Kundu et al. in Universal Source-Free Domain Adaptation, this joint access requirement creates severe bottlenecks. In real-world applications—ranging from medical imaging to proprietary corporate software—the original source data cannot be shared due to strict privacy regulations (such as GDPR), intellectual property protections, or the sheer logistical cost of transmitting massive datasets.

To bypass these constraints, a new paradigm has emerged: adapting models using only the unlabeled target data and a pretrained source model. This direction encompasses Source-Free Domain Adaptation (SFDA) and Test-Time Adaptation (TTA).

The Core Intuition: The Model as a Proxy

If we cannot look at the source data, how can we adapt a model to a new target domain? The key insight is that the pretrained model itself acts as a compressed representation of the source domain. Even without raw source samples, the model's weights contain the decision boundaries and feature extractors optimized for that source data.

As surveyed by Jian Liang 0001 et al. in A Comprehensive Survey on Test-Time Adaptation Under Distribution Shifts, instead of explicitly aligning source and target data distributions, source-free methods use the model's own behavior on target data to infer and correct for distribution shifts. When target data is out-of-distribution, the model's predictions become fuzzy, uncertain, or structurally inconsistent. By optimizing the model to restore clarity and consistency, it implicitly aligns itself with the new domain.

Sharpening Predictions via Confidence Optimization

When a model encounters out-of-distribution data, its prediction confidence typically drops, leading to high-entropy outputs. A foundational strategy in source-free adaptation is to force the model to make sharp, decisive predictions on the target data.

However, naive entropy minimization can cause vanishing gradients or collapsed solutions where the model trivially predicts the same class for every input. To circumvent this, Chaithanya Kumar Mummadi et al. in Test-Time Adaptation to Distribution Shift by Confidence Maximization and Input Transformation introduce non-saturating likelihood ratio losses combined with learnable input transformations, ensuring stable gradient flow during test-time optimization. Similarly, in cross-domain remote sensing, Yu Liang et al. in Low Saturation Confidence Distribution-based Test-Time Adaptation for Cross-Domain Remote Sensing Image Classification utilize specialized confidence distribution losses to rapidly adjust models on-the-fly without losing discriminative power.

Self-Training Guided by Priors

Another powerful way to leverage the model's internal knowledge is self-training: using the model's own high-confidence predictions as "pseudo-labels" to supervise its own fine-tuning. The danger here is error propagation—if the model makes a confident but incorrect prediction, it reinforces its own mistake.

To prevent this feedback loop, frameworks introduce structural or task-specific priors:

Consistency Across Modalities and Tasks

When multiple data streams or auxiliary tasks are available, consistency training acts as a powerful regularizer. If a model is robust, its semantic understanding should remain stable across different views or modalities of the same scene.

Yifang Yin et al. in CrossMatch: Source-Free Domain Adaptive Semantic Segmentation via Cross-Modal Consistency Training exploit this in semantic segmentation, using depth information as an auxiliary guide during training to enforce cross-modal consistency. For hazardous environments like nighttime driving, Yexin Liu et al. in Test-Time Adaptation for Nighttime Color-Thermal Semantic Segmentation combine color (RGB) and thermal images via an entropy-based fusion branch, allowing the modalities to mutually correct each other without human supervision. Similarly, Divya Kothandaraman et al. in SS-SFDA : Self-Supervised Source-Free Domain Adaptation for Road Segmentation in Hazardous Environments combine curriculum learning with online pseudo-labeling to adapt road segmentation models to adverse weather conditions like rain or fog.

To make this process fast enough for real-time deployment, Bin Li in Fast Adaptation for Human Pose Estimation via Meta-Optimization introduces a meta-learning framework that couples the primary task with a self-supervised image inpainting task. By learning how to learn from this auxiliary task, the model adapts to severe distribution shifts in as few as five iterations.

Geometric and Subspace Alignment

Rather than modifying the model's classification boundaries directly, some methods focus on aligning the underlying geometry of the feature space.

Jian Liang et al. in Distant Supervised Centroid Shift: A Simple and Efficient Approach to Visual Domain Adaptation. demonstrate that target domain class centroids can be mapped to a shared subspace where they are slightly shifted from the source centroids, achieving highly efficient adaptation with linear time complexity. Taking this a step further for fully test-time scenarios, Kowshik Thopalli et al. in Domain Alignment Meets Fully Test-Time Adaptation introduce CATTAn, which projects target data onto a low-dimensional subspace estimated directly from the source model's parameters, achieving distribution alignment with virtually zero memory or privacy overhead.

On-the-Fly and Training-Free Adaptation

The ultimate goal of this research direction is to enable seamless deployment on edge devices where backpropagation is too computationally expensive. Qiyuan Dai et al. in Free on the Fly: Enhancing Flexibility in Test-Time Adaptation with Online EM address this with FreeTTA, a training-free framework that adapts Vision-Language Models using an online Expectation-Maximization (EM) algorithm. By modeling the target distribution statistically without updating weights via backpropagation, they eliminate the computational and memory overhead traditionally required for adaptation, allowing models to adapt safely and efficiently on the fly.

Key Foundational Work

Structured Domain Adaptation for 3D Keypoint Estimation (2019) — contributed 1 concept elements to this direction.
Adapting Object Detectors with Conditional Domain Normalization (2020) — contributed 1 concept elements to this direction.
Universal Source-Free Domain Adaptation (2020) — contributed 1 concept elements to this direction.
History & citationVersion 1 · 2026-10-04

Current · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_source_data_dependency_79eecdeb,
  title = {source data dependency},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/source-data-dependency/rdr_79eecdebbe4e48a8a9f463df66224ba2},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}

This exact version (version 1, frozen text):

@misc{lacuna_source_data_dependency_79eecdeb_v1,
  title = {source data dependency},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/source-data-dependency/rdr_79eecdebbe4e48a8a9f463df66224ba2/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}
About

These directions overlap with this one through shared papers.

See something wrong? Report a mistake