Robust Multi-View Representation Learning (Student Abstract)

Sibi Venkatesan, James Kyle Miller, Artur Dubrawski

Abstract

Multi-view data has become ubiquitous, especially with multi-sensor systems like self-driving cars or medical patient-side monitors. We propose two methods to approach robust multi-view representation learning with the aim of leveraging local relationships between views.The first is an extension of Canonical Correlation Analysis (CCA) where we consider multiple one-vs-rest CCA problems, one for each view. We use a group-sparsity penalty to encourage finding local relationships. The second method is a straightforward extension of a multi-view AutoEncoder with view-level drop-out.We demonstrate the effectiveness of these methods in simple synthetic experiments. We also describe heuristics and extensions to improve and/or expand on these methods.
BibTeX
@inproceedings{venkatesan2020robust,
  author = {Sibi Venkatesan and James Kyle Miller and Artur Dubrawski},
  title = {{Robust Multi-View Representation Learning (Student Abstract)}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2020},
  doi = {10.1609/aaai.v34i10.7242},
}
Figure