On automatic voice casting for expressive speech: Speaker recognition vs. speech classification

Nicolas Obin, Axel Roebel, Grégoire Bachman

Abstract

This paper presents the first large-scale automatic voice casting system, and explores the adaptation of speaker recognition techniques to measure voice similarities. The proposed system is based on the representation of a voice by classes (e.g., age/gender, voice quality, emotion). First, a multi-label system is used to classify speech into classes. Then, the output probabilities for each class are concatenated to form a vector that represents the vocal signature of a speech recording. Finally, a similarity search is performed on the vocal signatures to determine the set of target actors that are the most similar to a speech recording of a source actor. In a subjective experiment conducted in the real-context of voice casting for video games, the multi-label system clearly outperforms standard speaker recognition systems. This indicates evidence that speech classes successfully capture the principal directions that are used in the perception of voice similarity.
BibTeX
@inproceedings{obin2014automatic,
  author = {Nicolas Obin and Axel Roebel and Grégoire Bachman},
  title = {{On automatic voice casting for expressive speech: Speaker recognition vs. speech classification}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2014},
  doi = {10.1109/icassp.2014.6853737},
}
Figure