Experts Versus All-Rounders: Target Language Extraction for Multiple Target Languages

Marvin Borsdorf, Kevin Scheck, Haizhou Li, Tanja Schultz

Abstract

Target language extraction (TLE) is a novel task in the field of selective auditory attention, which seeks to extract all speech signals that are spoken in a target language from other sources in a multilingual cocktail party. In our prior studies, a TLE model was trained to extract a predefined, single target language, referred to as Single-TLE. In this paper, we extend the Single-TLE framework to Multi-TLE. Multi-TLE models can also extract all speech signals of one specific target language, but they are optimized on a set of multiple target languages during training. As such, they learn the characteristics of several target languages and can replace multiple Single-TLE models without retraining. We perform experiments on the GlobalPhoneMCP database and incorporate a dynamic language mixing scheme for training. The Multi-TLE model does not only outperform Single-TLE models, but when given a language ID as additional input, it is also able to extract the speech of a specific target language from a mixture which contains multiple learned target languages.
BibTeX
@inproceedings{borsdorf2022experts,
  author = {Marvin Borsdorf and Kevin Scheck and Haizhou Li and Tanja Schultz},
  title = {{Experts Versus All-Rounders: Target Language Extraction for Multiple Target Languages}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2022},
  doi = {10.1109/icassp43922.2022.9746130},
}

Loading related content...

Figure