Generalized Zero-Shot Learning via Aligned Variational Autoencoders

Edgar Schönfeld, Sayna Ebrahimi, Samarth Sinha, Trevor Darrell, Zeynep Akata

Abstract

Most approaches in generalized zero-shot learning rely on cross-modal mapping between an image feature space and a class embedding space or on generating artificial image features. However, learning a shared cross-modal embedding by aligning the latent spaces of modality-specific autoencoders is shown to be promising in (generalized) zero-shot learning. While following the same direction, we also take artificial feature generation one step further and propose a model where a shared latent space of image features and class embeddings is learned by aligned variational autoencoders, for the purpose of generating latent features to train a softmax classifier. We evaluate our learned latent features on conventional benchmark datasets and establish a new state of the art on generalized zero-shot learning. Moreover, our results on ImageNet with various zero-shot splits show that our latent features generalize well in large-scale settings. The extended version of this work is accepted for publication at CVPR 2019[16].
BibTeX
@inproceedings{schonfeld2019generalized,
  author = {Edgar Schönfeld and Sayna Ebrahimi and Samarth Sinha and Trevor Darrell and Zeynep Akata},
  title = {{Generalized Zero-Shot Learning via Aligned Variational Autoencoders}},
  booktitle = {Workshops @ CVPR},
  year = {2019},
  url = {https://openreview.net/forum?id=rNNL2dDClym},
}

Loading related content...

Figure