Speaker and language factorization in DNN-based TTS synthesis
Lists
Only you see this
Abstract
We have successfully proposed to use multi-speaker modelling in DNN-based TTS synthesis for improved voice quality with limited available data from a speaker. In this paper, we propose a new speaker and language factorized DNN, where speaker-specific layers are used for multi-speaker modelling, and shared layers and language-specific layers are employed for multi-language, linguistic feature transformation. Experimental results on a speech corpus of multiple speakers in both Mandarin and English show that the proposed factorized DNN can not only achieve a similar voice quality as that of a multi-speaker DNN, but also perform polyglot synthesis with a monolingual speaker's voice.
BibTeX
@inproceedings{fan2016speaker,
author = {Yuchen Fan and Yao Qian and Frank K. Soong and Lei He},
title = {{Speaker and language factorization in DNN-based TTS synthesis}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2016},
url = {https://openreview.net/forum?id=fYSLQbIpmrx},
}Loading related content...