Exploring the Quality of GAN Generated Images for Person Re-Identification

Yiqi Jiang, Weihua Chen, Xiuyu Sun, Xiaoyu Shi, Fan Wang, Hao Li

Abstract

Recently, GAN-based methods have demonstrated strong effectiveness in generating augmentation data for person re-identification (ReID), bridging the gap between domains and enriching data variety. However, most ReID works utilize all GAN-generated data indiscriminately or evaluate quality at the dataset level, ignoring image-level features essential for ReID. This paper analyzes the characteristics of ReID samples to determine what makes a GAN-generated image "good." We propose examining each sample with id-consistency and diversity constraints by mapping images into different feature spaces. Using a metric-based sampling method, we demonstrate that curated synthetic data significantly outperforms full augmentation sets. Our method shows effectiveness across supervised and unsupervised domain adaptation tasks.

Introduction: The Problem with "Black Box" Augmentation

Person Re-Identification (ReID) involves matching individuals across non-overlapping camera views, a task complicated by variations in lighting, pose, and camera style. While Generative Adversarial Networks (GANs) are frequently used to expand training sets, most existing methods treat GAN output as a black box. They often use all generated images or rely on dataset-level metrics like FID, which can include noisy images that lose identity information or redundant images that add no value. This research seeks to define and select high-quality synthetic samples that actually benefit the ReID model.

Methodology: Metric-based Sampling

The proposed pipeline filters synthetic data through two distinct feature spaces before training:

  1. Consistency Space ($E_c$): Captures identity-related features (clothing, hair, gender) while ignoring style. An image is kept if it is close to the "identity center" of real images.
  2. Diversity Space ($E_d$): Captures variations like pose and lighting. An image is kept if it is sufficiently far from real images, ensuring it provides new information.
Visualizing Id-Consistency and Diversity Constraints for GAN sample selection.

Additionally, the authors use Local Outlier Factor (LOF) density filtering to remove clusters of nearly identical synthetic images, preventing overfitting on GAN artifacts. Finally, a refined training strategy is employed: while real data uses both Cross-Entropy and Triplet loss, filtered GAN data uses only Cross-Entropy loss to mitigate sensitivity to remaining noise.

Key Insights: Quality Over Quantity

The study reveals that blindly adding GAN data can degrade performance. On the MSMT-17 dataset, using the full GAN output dropped Rank@1 accuracy, whereas using the filtered "good" images improved it.

Examples of 'Good Augmentation' samples selected by the proposed filtering pipeline.
  • The "Goldilocks" Zone: Ideal synthetic images must be consistent enough to maintain identity but diverse enough to teach the model new environmental variations.
  • Disentanglement and Diversity Proxies: Using specialized encoders (like ISGAN) for identity and general models (like ImageNet-pretrained ResNet-50) for diversity proved most effective. Surprisingly, ImageNet-trained models are better judges of environmental diversity than models trained specifically on humans.

Results and Performance

The proposed method consistently outperformed state-of-the-art benchmarks:

  • Supervised ReID (Market-1501): Achieved 96.2% Rank@1 and 89.2% mAP, surpassing both the baseline and full-augmentation approaches.
  • Unsupervised Domain Adaptation (Duke → Market): The baseline mAP of 62.8% was boosted to 78.6%, outperforming specialized UDA methods like MMT.
  • Efficiency: The system achieved superior results using only approximately 30% of the total generated GAN data, highlighting the power of selective sampling.

Conclusion

This work demonstrates that not every GAN-generated image is beneficial for ReID. By applying identity-consistency and diversity constraints, researchers can significantly improve model robustness and accuracy while reducing the computational load of training on redundant or noisy synthetic data. Future work may explore more sophisticated sampling metrics and improved disentanglement encoders to further refine the selection process.

Summary updated

Abstract

Recently, GAN based method has demonstrated strong effectiveness in generating augmentation data for person re-identification (ReID), on account of its ability to bridge the gap between domains and enrich the data variety in feature space. However, most of the ReID works pick all the GAN generated data as additional training samples or evaluate the quality of GAN generation at the entire data set level, ignoring the image-level essential feature of data in ReID task. In this paper, we analyze the in-depth characteristics of ReID sample and solve the problem of "What makes a GAN-generated image good for ReID". Specifically, we propose to examine each data sample with id-consistency and diversity constraints by mapping image onto different spaces. With a metric-based sampling method, we demonstrate that not every GAN-generated data is beneficial for augmentation. Models trained with data filtered by our quality evaluation outperform those trained with the full augmentation set by a large margin. Extensive experiments show the effectiveness of our method on both supervised ReID task and unsupervised domain adaptation ReID task.
BibTeX
@inproceedings{jiang2021exploring,
  author = {Yiqi Jiang and Weihua Chen and Xiuyu Sun and Xiaoyu Shi and Fan Wang and Hao Li},
  title = {{Exploring the Quality of GAN Generated Images for Person Re-Identification}},
  booktitle = {ACM Multimedia},
  year = {2021},
  url = {https://openreview.net/forum?id=wOg8NB2SR6},
}
Figure