Exocentric to Egocentric Image Generation Via Parallel Generative Adversarial Network

Gaowen Liu, Hao Tang, Hugo Latapie, Yan Yan

Abstract

Cross-view image generation has been recently proposed to generate images of one view from another dramatically different view. In this paper, we investigate exocentric (third-person) view to egocentric (first-person) view image generation. This is a challenging task since egocentric view sometimes is remarkably different from exocentric view. Thus, transforming the appearances across the two views is a nontrivial task. To this end, we propose a novel Parallel Generative Adversarial Network (P-GAN) with a novel cross-cycle loss to learn the shared information for generating egocentric images from exocentric view. We also incorporate a novel contextual feature loss in the learning procedure to capture the contextual information in images. Extensive experiments on the Exo-Ego datasets [1] show that our model outperforms the state-of-the-art approaches.
BibTeX
@inproceedings{liu2020exocentric,
  author = {Gaowen Liu and Hao Tang and Hugo Latapie and Yan Yan},
  title = {{Exocentric to Egocentric Image Generation Via Parallel Generative Adversarial Network}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2020},
  doi = {10.1109/icassp40776.2020.9053957},
}
Figure