Multi-View Information Bottleneck Without Variational Approximation

Qi Zhang, Shujian Yu, Jingmin Xin, Badong Chen

Abstract

By "intelligently" fuse the complementary information across different views, multi-view learning is able to improve the performance of classification task. In this work, we extend the information bottleneck principle to supervised multi-view learning scenario and use the recently proposed matrix-based Rényi’s α-order entropy functional to optimize the resulting objective directly, without the necessity of variational approximation or adversarial training. Empirical results in both synthetic and real-world datasets suggest that our method enjoys improved robustness to noise and redundant information in each view, especially given limited training samples. Code is available at https://github.com/archy666/MEIB.
BibTeX
@inproceedings{zhang2022multi,
  author = {Qi Zhang and Shujian Yu and Jingmin Xin and Badong Chen},
  title = {{Multi-View Information Bottleneck Without Variational Approximation}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2022},
  doi = {10.1109/icassp43922.2022.9747614},
}

Loading related content...

Figure