Multimodal Emotion Recognition by extracting common and modality-specific information
Lists
Only you see this
Abstract
Emotion recognition technologies have been widely used in numerous areas including advertising, healthcare and online education. Previous works usually recognize the emotion from either the acoustic or the visual signal, yielding unsatisfied performances and limited applications. To improve the inference capability, we present a multimodal emotion recognition model, EMOdal. Apart from learning the audio and visual data respectively, EMOdal efficiently learns the common and modality-specific information underlying the two kinds of signals, and therefore improves the inference ability. The model has been evaluated on our large-scale emotional data set. The comprehensive evaluations demonstrate that our model outperforms traditional approaches.
BibTeX
@inproceedings{zhang2018multimodal,
author = {Wei Zhang and Weixi Gu and Fei Ma and Shiguang Ni and Lin Zhang and Shao-Lun Huang},
title = {{Multimodal Emotion Recognition by extracting common and modality-specific information}},
booktitle = {SenSys},
year = {2018},
url = {https://openreview.net/forum?id=S6cn-DL_3sz},
}Loading related content...