An experimental study on joint modeling of mixed-bandwidth data via deep neural networks for robust speech recognition

Jianqing Gao, Jun Du, Changqing Kong, Huaifang Lu, Enhong Chen, Chin-Hui Lee

Abstract

We propose joint modeling strategies leveraging upon large-scale mixed-band training speech for recognition of both narrowband and wideband data based on deep neural networks (DNNs). We utilize conventional down-sampling and up-sampling schemes to go between narrowband and wideband data. We also explore DNN-based speech bandwidth expansion (BWE) to map some acoustic features from narrowband to wideband speech. By arranging narrowband and wideband features at the input or the output level of BWE-DNN, and combining down-sampling and up-sampling data, different DNNs can be established. Our experiments on a Mandarin speech recognition task show that the hybrid DNNs for joint modeling of mixed-band speech yield significant performance gains over both the narrowband and wideband speech models, well-trained separately, with a relative character error rate reduction of 7.9% and 3.9% on narrowband and wideband data, respectively. Furthermore, the proposed strategies also consistently outperform other conventional DNN-based methods.
BibTeX
@inproceedings{gao2016experimental,
  author = {Jianqing Gao and Jun Du and Changqing Kong and Huaifang Lu and Enhong Chen and Chin-Hui Lee},
  title = {{An experimental study on joint modeling of mixed-bandwidth data via deep neural networks for robust speech recognition}},
  booktitle = {IJCNN},
  year = {2016},
  doi = {10.1109/ijcnn.2016.7727253},
}

Loading related content...

Figure