WaveFFJORD: FFJORD-Based Vocoder for Statistical Parametric Speech Synthesis

Ning-Qian Wu, Zhen-Hua LingICASSP 2020 · OpenReview

Abstract

Free-form Jacobian of Reversible Dynamics(FFJORD) is a flowbased invertible generative model defined by ordinary differential equations (ODE). Inspired by WaveGlow, in this paper, we propose WaveFFJORD, a neural vocoder that can synthesize speech waveforms from acoustic features, by combining FFJORD and WaveNet. WaveFFJORD can generate speech waveforms directly by the blackbox ODE solvers, without the need for autoregressive structures. Our experimental results show that WaveFFJORD can achieve a smaller model size, lower memory cost, and better speech quality than WaveGlow. Besides, the ODE framework allows users to control the generation speed and quality by setting the error tolerance of the ODE solvers.
BibTeX
@inproceedings{wu2020waveffjord,
  author = {Ning-Qian Wu and Zhen-Hua Ling},
  title = {{WaveFFJORD: FFJORD-Based Vocoder for Statistical Parametric Speech Synthesis}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2020},
  url = {https://openreview.net/forum?id=XV3jVzHeYI},
}

Loading related content...

Figure