Singing Expression Transfer from One Voice to Another for a Given Song

Sangeon Yong, Juhan NamICASSP 2018 · OpenReview

Abstract

We present a vocal processing algorithm to automatically transfer singing expressions from one voice to another for a given song. Depending on singers' competence, a song can be rendered with great variations in terms of local tempo, pitch and dynamics. The proposed method temporally aligns a pair of singing voices using melodic and lyrical features that they have in common. Then, it conducts time-scale modification on the source voice according to the time-stretching ratio from the alignment result after smoothing. Once the two voices are aligned, the method modifies pitch and energy expressions of the source voice in a frame-by-frame manner using a pitch-synchronous overlap-add algorithm and a simple amplitude envelope matching. We designed our experiment to transfer singing expressions from a highly technical singer to a plain singer. The results show that our proposed method improves the singing quality effectively.
BibTeX
@inproceedings{yong2018singing,
  author = {Sangeon Yong and Juhan Nam},
  title = {{Singing Expression Transfer from One Voice to Another for a Given Song}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2018},
  url = {https://openreview.net/forum?id=23nhkuxUbkE},
}

Loading related content...

Figure