Feature Integration via Semi-Supervised Ordinally Multi-Modal Gaussian Process Latent Variable Model

Kyohei Kamikawa, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

Abstract

This paper presents a method of feature integration via semi-supervised ordinally multi-modal Gaussian process latent variable model (Semi-OMGP). The proposed method transforms multimodal features into common latent variables suitable for users' interest level estimation. For dealing with the multi-modal features, the proposed method newly derives Semi-OMGP. Semi-OMGP has two contributions. First, Semi-OMGP is suitable for integration between heterogeneous modalities with different distributions by assuming that the similarity matrices of these modalities as observations are generated from latent variables. Second, Semi-OMGP can efficiently use label information by introducing an operator considering the ordinal grade into the prior distribution of latent variables when obtained label information is partially given. Semi-OMGP can simultaneously realize the above contributions, and successful multi-modal feature integration becomes feasible. Experimental results show the effectiveness of the proposed method.
BibTeX
@inproceedings{kamikawa2021feature,
  author = {Kyohei Kamikawa and Keisuke Maeda and Takahiro Ogawa and Miki Haseyama},
  title = {{Feature Integration via Semi-Supervised Ordinally Multi-Modal Gaussian Process Latent Variable Model}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2021},
  doi = {10.1109/icassp39728.2021.9414109},
}

Loading related content...

Figure