Unsupervised speaker adaptation for DNN-based TTS synthesis
Lists
Only you see this
Abstract
Multi-speaker TTS trained with a general DNN has outperformed individually modelled baseline [1]. Multi-speaker DNN takes advantages of larger amount of training data from multiple speakers to find robust transformations in the hidden layers and covers more speaker variability in the output regression layer. In this paper, we propose a new approach to unsupervised speaker adaptation with multi-speaker DNN. It takes advantage of shared hidden transformation to search for the labels of unlabelled acoustic frames and the found labels are used for speaker adaption. Experimental results show that the new approach of unsupervised adaptation can achieve comparable performance with supervised adaptation both objectively and subjectively. We further extend it to cross-lingual adaptation. It can remove non-native accent and improve the naturalness while keep the same speaker's characteristics.
BibTeX
@inproceedings{fan2016unsupervised,
author = {Yuchen Fan and Yao Qian and Frank K. Soong and Lei He},
title = {{Unsupervised speaker adaptation for DNN-based TTS synthesis}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2016},
url = {https://openreview.net/forum?id=pSGZ7HuJjsm},
}Loading related content...