Beyond Domain Adaptation: Unseen Domain Encapsulation via Universal Non-volume Preserving Models

Thanh-Dat Truong, Chi Nhan Duong, Khoa Luu, Minh-Triet Tran, Minh N. DoarXiv 2018 · OpenReview

Abstract

Recognition across domains is a critical challenge in computer vision, yet most existing methods rely on Domain Adaptation (DA), which requires access to target domain data during training. This paper addresses the more rigorous problem of Domain Generalization (DG), where models must perform in entirely unseen environments. We propose a novel framework called Unseen Domain Encapsulation utilizing Universal Non-volume Preserving (UNVP) models. By mapping source data into a tractable latent space and modeling environmental variations through adversarial augmentation, our approach creates robust models capable of blind deployment. Experiments across digit recognition, face recognition, and pedestrian detection demonstrate that UNVP consistently outperforms standard deep learning architectures and competitive adaptation baselines.

Introduction: From Adaptation to Encapsulation

Deep learning models often suffer from significant performance degradation when deployed in environments that differ from their training data—a phenomenon known as domain shift. While Domain Adaptation (DA) has been the standard solution, it is often impractical because it requires a "sneak peek" at the target data during the training phase. In real-world scenarios, such as deploying a pedestrian detector in a new city or under varying weather conditions, target data is rarely available beforehand.

Conceptual comparison between Domain Adaptation (A) and the proposed Domain Encapsulation (B).

This research shifts the focus from adapting to a known target to encapsulating potential variations within the model itself. As illustrated in Figure 1, while DA bridges a specific gap between Source A and Target B, Domain Encapsulation aims to generalize from Source A to multiple unknown targets (B, C, D) simultaneously.

Methodology: Universal Non-volume Preserving (UNVP)

The proposed framework leverages the properties of Non-volume Preserving (NVP) architectures to achieve robust domain generalization. The process is divided into three core stages:

  1. Latent Mapping and Density Estimation: The system uses an invertible mapping function to project source images into a latent space. Unlike standard CNNs, this architecture allows for exact density estimation, enabling the model to mathematically define the "boundaries" of the training environment.
  2. Environment Modeling: Within the latent space, source data is modeled as a set of class-specific Gaussian distributions. This structured representation allows the model to understand the semantic core of the data independently of pixel-level noise.
  3. Adversarial Latent Augmentation: To prepare for unseen shifts, the model generates "hard" examples by perturbing latent representations. It identifies points that are mathematically distant from the source distribution but semantically consistent. By iteratively training on these fictitious variations, the model effectively "widens" its understanding, encapsulating a broader range of potential environments.
Architecture of the Universal Non-volume Preserving (UNVP) framework.

Experimental Evaluation

The UNVP framework was benchmarked across three diverse visual recognition tasks to test its cross-domain robustness.

Digit Recognition

Using MNIST as the source domain, the model was tested on MNIST-M, USPS, and SVHN. On the challenging SVHN dataset, which was entirely unseen during training, the UNVP approach achieved 40.22% accuracy, surpassing the 37.89% achieved by a standard CNN.

Face Recognition

Testing on Extended Yale-B and CMU-PIE datasets focused on extreme illumination shifts. The UNVP model demonstrated remarkable resilience in low-light conditions; on the Extended Yale-B "Dark" set, it reached 70.09% accuracy, whereas a standard CNN dropped to 49.15%.

Pedestrian Detection

The model's ability to handle sensor shifts was tested by training on RGB images and deploying on Thermal (infrared) imagery. The UNVP encapsulation improved the mean Average Precision (mAP) from 52.83% to 53.30%, indicating that latent space augmentation helps bridge the gap between visible and thermal spectra.

Conclusion

Unseen Domain Encapsulation via UNVP offers a promising path forward for deploying AI in the wild. By moving beyond the limitations of domain adaptation and focusing on latent space robustness, this method allows for the creation of "plug-and-play" models that are inherently prepared for the unknown. Future work will focus on reducing the computational overhead of invertible models and testing the framework against more extreme semantic domain gaps.

Summary updated

Abstract

Recognition across domains has recently become an active topic in the research community. However, it has been largely overlooked in the problem of recognition in new unseen domains. Under this condition, the delivered deep network models are unable to be updated, adapted or fine-tuned. Therefore, recent deep learning techniques, such as: domain adaptation, feature transferring, and fine-tuning, cannot be applied. This paper presents a novel Universal Non-volume Preserving approach to the problem of domain generalization in the context of deep learning. The proposed method can be easily incorporated with any other ConvNet framework within an end-to-end deep network design to improve the performance. On digit recognition, we benchmark on four popular digit recognition databases, i.e. MNIST, USPS, SVHN and MNIST-M. The proposed method is also experimented on face recognition on Extended Yale-B, CMU-PIE and CMU-MPIE databases and compared against other the state-of-the-art methods. In the problem of pedestrian detection, we empirically observe that the proposed method learns models that improve performance across a priori unknown data distributions.
BibTeX
@misc{truong2018beyond,
  author = {Thanh-Dat Truong and Chi Nhan Duong and Khoa Luu and Minh-Triet Tran and Minh N. Do},
  title = {{Beyond Domain Adaptation: Unseen Domain Encapsulation via Universal Non-volume Preserving Models}},
  year = {2018},
  eprint = {1812.03407},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1812.03407},
}
Figure