Speech Emotion Recognition via Attention-based DNN from Multi-Task Learning

Fei Ma, Weixi Gu, Wei Zhang, Shiguang Ni, Shao-Lun Huang, Lin ZhangSenSys 2018 · OpenReview

Abstract

Speech unlocks the huge potentials in emotion recognition. High accurate and real-time understanding of human emotion via speech assists Human-Computer Interaction. Previous works are often limited in either coarse-grained emotion learning tasks or the low precisions on the emotion recognition. To solve these problems, we construct a real-world large-scale corpus composed of 4 common emotions (i.e., anger, happiness, neutral and sadness). We also propose a multi-task attention-based DNN model (i.e., MT-A-DNN) on the emotion learning. MT-A-DNN efficiently learns the high-order dependency and non-linear correlations underlying in the audio data. Extensive experiments show that MT-A-DNN outperforms conventional methods on the emotion recognition. It could take one step further on the real-time acoustic emotion recognition in many smart audio-devices.
BibTeX
@inproceedings{ma2018speech,
  author = {Fei Ma and Weixi Gu and Wei Zhang and Shiguang Ni and Shao-Lun Huang and Lin Zhang},
  title = {{Speech Emotion Recognition via Attention-based DNN from Multi-Task Learning}},
  booktitle = {SenSys},
  year = {2018},
  url = {https://openreview.net/forum?id=g0w0fwnvlAkF},
}

Loading related content...

Figure