Automatic measurement of affective valence and arousal in speech

Meysam Asgari, Géza Kiss, Jan P. H. van Santen, Izhak Shafran, Xubo SongICASSP 2014 · OpenReview

Abstract

Methods are proposed for measuring affective valence and arousal in speech. The methods apply support vector regression to prosodic and text features to predict human valence and arousal ratings of three stimulus types: speech, delexicalized speech, and text transcripts. Text features are extracted from transcripts via a lookup table listing per-word valence and arousal values and computing per-utterance statistics from the per-word values. Prediction of arousal ratings of delexicalized speech and of speech from prosodic features was successful, with accuracy levels not far from limits set by the reliability of the human ratings. Prediction of valence for these stimulus types as well as prediction of both dimensions for text stimuli proved more difficult, even though the corresponding human ratings were as reliable. Text based features did add, however, to the accuracy of prediction of valence for speech stimuli. We conclude that arousal of speech can be measured reliably, but not valence, and that improving the latter requires better lexical features.
BibTeX
@inproceedings{asgari2014automatic,
  author = {Meysam Asgari and Géza Kiss and Jan P. H. van Santen and Izhak Shafran and Xubo Song},
  title = {{Automatic measurement of affective valence and arousal in speech}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2014},
  url = {https://openreview.net/forum?id=rAgZxYjFY80},
}

Loading related content...

Figure