A Novel Bag-of-Optimised-Clusters Front-End for Speech based Continuous Emotion Prediction
Lists
Only you see this
Abstract
Almost all current speech based emotion prediction systems employ front-ends that approximately represent the distribution of frame based features over a suitable window, typically via a set of statistical functionals or the use of Bag-of-Audio-Words (BoAW) features. These front-ends are designed either by manual selection of appropriate statistical functionals, via a feature selection approach or unsupervised clustering of the frame-based features and may not be optimal for the task at hand. This paper proposes a novel front-end that discriminatively learns feature clusters to generate a codebook optimised for emotion prediction, which is then used to generate a Bag-of-Optimised-Clusters (BoOC) feature set. Moreover, this front-end is implemented as a sequence of neural network layers that allow both the proposed front-end and a suitable deep learning backend to be jointly trained. The Bag-of-Optimised-Clusters frontend is tested on the RECOLA database and results show that it outperforms the well-established BoAW features.
BibTeX
@inproceedings{bose2019novel,
author = {Deboshree Bose and Ting Dang and Vidhyasaharan Sethu and Eliathamby Ambikairajah and Sarith Fernando},
title = {{A Novel Bag-of-Optimised-Clusters Front-End for Speech based Continuous Emotion Prediction}},
booktitle = {ACII},
year = {2019},
doi = {10.1109/acii.2019.8925490},
}Loading related content...