Syllabic level automatic synchronization of music signals and text lyrics

Denny Iskandar, Ye Wang, Min-Yen Kan, Haizhou Li

Abstract

We present a framework to synchronize pop music to corresponding text lyric. We refine line level alignment achievable by existing work to syllabic level by using a dynamic programming process. Our main contribution is using music knowledge to constrain the dynamic programming search. This is done by modeling (1) non-uniform note length distribution and (2) a note length distribution for each section type (for example intro, chorus, and bridge). These reduce alignment error by 6.4% and improve time efficiency by a factor of 2.2.
BibTeX
@inproceedings{iskandar2006syllabic,
  author = {Denny Iskandar and Ye Wang and Min-Yen Kan and Haizhou Li},
  title = {{Syllabic level automatic synchronization of music signals and text lyrics}},
  booktitle = {ACM Multimedia},
  year = {2006},
  doi = {10.1145/1180639.1180777},
}

Loading related content...

Figure