DALocNet: Improving Localization Accuracy for Domain Adaptive Object Detection

Yushan Yu, Xuemiao Xu, Xiaowei Hu, Pheng-Ann Heng

Introduction

In computer vision, the ability to generalize across different environments is a critical challenge. Domain adaptive object detection (DAOD) attempts to bridge the gap between a labeled source domain (e.g., synthetic data or clear weather) and an unlabeled target domain (e.g., real-world photos or foggy weather). While existing unsupervised domain adaptation (UDA) methods excel at identifying what an object is, they often struggle with where it is, leading to "blurry" or misaligned bounding boxes. DALocNet is a novel framework designed to sharpen this focus by prioritizing fine-grained spatial details.

Addressing the Localization Gap

The primary issue in standard UDA is that global feature alignment can wash out the fine-grained spatial details necessary for exact bounding box placement. DALocNet introduces two key architectural enhancements to the standard Domain Adaptive Faster R-CNN to combat this:

  1. Refined Pseudo-Labeling with Weighted Loss: To leverage target domain data, the model generates "pseudo labels" using a pre-trained adaptive model. To mitigate the noise inherent in these guesses, DALocNet employs a weighted $L_1$ loss function that prioritizes high-confidence predictions, allowing the network to learn localization cues without being misled by low-quality guesses.
  2. Shallow-Layer Residual Blocks: Localization cues are primarily encoded in the early (shallow) layers of a Convolutional Neural Network (CNN). By inserting additional residual blocks into the first three layers of the target feature extractor, DALocNet preserves and enhances the high-resolution spatial information required for precise detection.

Datasets and Experimental Setup

The researchers evaluated DALocNet across three distinct domain-shift scenarios to test its robustness:

  • Cityscapes → Foggy-Cityscapes: Adapting from clear weather to synthetic fog.
  • SIM 10k → Cityscapes: Bridging the gap between synthetic gaming environments (GTA V) and real-world street scenes.
  • Pascal VOC → Clipart1k: Handling extreme style shifts from photorealistic images to artistic renderings.
A synthetic image from the SIM 10k dataset, representing the source domain in synthetic-to-real experiments.

Performance and Insights

DALocNet consistently outperformed state-of-the-art methods across all benchmarks. In the Foggy-Cityscapes task, it achieved a 33.27% mAP, a significant improvement over the 29.28% baseline.

Beyond standard mAP, the authors emphasized the Optimal Localization Recall Precision (oLRP) metric. Unlike mAP, oLRP explicitly penalizes localization errors, providing a clearer picture of how "tight" the bounding boxes actually are. DALocNet showed marked improvements in oLRP, confirming that its architectural changes successfully improved spatial awareness.

Qualitative detection results on the Cityscapes dataset, demonstrating improved localization and the ability to detect small or partially obscured objects.

Visual analysis confirms these quantitative gains; the model is particularly effective at identifying small or partially obscured objects that baseline models often miss entirely.

Conclusion

DALocNet demonstrates that focusing on shallow-layer spatial features and robust pseudo-labeling can significantly enhance localization in domain adaptive tasks. While challenges remain with highly occluded objects in complex scenes, the framework sets a new standard for precision in cross-domain object detection, moving beyond simple classification to achieve true spatial accuracy.

Summary updated

Abstract

Object detection assumes that the training data is identical to the testing data. However, the distributions of training and testing data, in practice, are different, thereby limiting the detection accuracy of objects. To solve this problem, recent works adopt domain adaptation techniques to reduce the domain discrepancy. In this paper, we present a novel deep neural network design for domain adaptive object detection by further improving the localization accuracy of objects. First, we present to refine the pseudo labels generated from the current object detection methods and use these labels with a weighted loss function to train the network on the target domain. Second, we insert several residual blocks into the shallow layers of a convolutional neural network used in the target domain to enhance detailed spatial information, which helps for object localization. We perform various experiments to evaluate our network on three widely-used public benchmark datasets for domain adaptive object detection. The experimental results show that our DALocNet performs favorably against the state-of-the-art methods on all the datasets quantitatively and qualitatively.
BibTeX
@article{yu2019dalocnet,
  author = {Yushan Yu and Xuemiao Xu and Xiaowei Hu and Pheng-Ann Heng},
  title = {{DALocNet: Improving Localization Accuracy for Domain Adaptive Object Detection}},
  journal = {IEEE Access},
  year = {2019},
  doi = {10.1109/access.2019.2915607},
}
Figure