Dynamic-attention based Encoder-decoder model for Speaker Extraction with Anchor speech

Hao Li, Xueliang Zhang, Guanglai Gao2019 · DOI

Abstract

Speech plays an important role in human-computer interaction. For many real applications, an annoying problem is that speech is often degraded by interfering noise. Extracting target speech from background interference is a meaningful and challenging task, especially when interference is also human voice. This work addresses the problem of extracting target speaker from interfering speaker with a short piece of anchor speech which is used to obtain the target speaker identify. We propose a encoder-decoder neural network architecture. Specifically, the encoder transforms the anchor speech to a embedding which is used to represent the identity of target speaker. The decoder utilizes the speaker identity to extract the target speech from mixture. To make a acoustic-related speaker identity, The dynamic-attention mechanism is utilized to build a time-varying embedding for each frame of the mixture. Systematic evaluation indicates that our approach improves the quality of speaker extraction.
BibTeX
@misc{li2019dynamic,
  author = {Hao Li and Xueliang Zhang and Guanglai Gao},
  title = {{Dynamic-attention based Encoder-decoder model for Speaker Extraction with Anchor speech}},
  year = {2019},
  doi = {10.1109/apsipaasc47483.2019.9023204},
}

Loading related content...

Figure