Representation Learning with Spectro-Temporal-Channel Attention for Speech Emotion Recognition
Lists
Only you see this
Abstract
Convolutional neural network (CNN) is found to be effective in learning representation for speech emotion recognition. CNNs do not explicitly model the associations or relative importance of features in the spectral/temporal/channel-wise axes. In this paper, we propose an attention module, named spectro-temporal-channel (STC) attention module that is integrated with CNN to improve representation learning ability. Our module infers an attention map along the three dimensions, namely time, frequency, and CNN channel. Experiments are conducted on the IEMOCAP database to evaluate the effectiveness of the proposed representation learning method. The results demonstrate that the proposed method outperforms the traditional CNN method by an absolute increase of 3.13% in terms of F1 score.
BibTeX
@inproceedings{guo2021representation,
author = {Lili Guo and Longbiao Wang and Chenglin Xu and Jianwu Dang and Eng Siong Chng and Haizhou Li},
title = {{Representation Learning with Spectro-Temporal-Channel Attention for Speech Emotion Recognition}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2021},
doi = {10.1109/icassp39728.2021.9414006},
}Loading related content...