High-Acoustic Fidelity Text To Speech Synthesis With Fine-Grained Control Of Speech Attributes

Rafael Valle, João Felipe Santos, Kevin J. Shih, Rohan Badlani, Bryan Catanzaro

Abstract

Recently developed neural-based TTS models have focused on robustness and finer control over acoustic features such as phoneme duration, energy, and F 0 , allowing users to have some degree of control over the prosody of the generated speech. We propose a model with fine grained attribute control, which also has better acoustic fidelity (attributes of the output which we want to control do not deviate from the control signals) than previously proposed models as shown in our experiments 1 . Unlike other models, our proposed model does not require fine-tuning the vocoder on its outputs, indicating that it generates higher quality mel-spectrograms that are closer to the ground-truth distribution than that of other models.
BibTeX
@inproceedings{valle2023high,
  author = {Rafael Valle and João Felipe Santos and Kevin J. Shih and Rohan Badlani and Bryan Catanzaro},
  title = {{High-Acoustic Fidelity Text To Speech Synthesis With Fine-Grained Control Of Speech Attributes}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2023},
  doi = {10.1109/icassp49357.2023.10096279},
}

Loading related content...

Figure