Leveraging Hidden Structure in Self-Supervised Learning

Emanuele Sansone

Abstract

This work considers the problem of learning structured representations from raw images using self-supervised learning. We propose a principled framework based on a mutual information objective, which integrates self-supervised and structure learning. Furthermore, we devise a post-hoc procedure to interpret the meaning of the learnt representations. Preliminary experiments on CIFAR-10 show that the proposed framework achieves higher generalization performance in downstream classification tasks and provides more interpretable representations compared to the ones learnt through traditional self-supervised learning.
BibTeX
@misc{sansone2021leveraging,
  author = {Emanuele Sansone},
  title = {{Leveraging Hidden Structure in Self-Supervised Learning}},
  year = {2021},
  eprint = {2106.16060},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2106.16060},
}

Loading related content...

Figure