Integration of speech separation, diarization, and recognition for multi-speaker meetings: Separated LibriCSS dataset

Desh Raj, Pavel Denisov, Zhuo Chen, Hakan Erdoğan, Zili Huang, Maokui He, Shinji Watanabe, Jun Du, Takuya Yoshioka, Yi Luo, Naoyuki Kanda, Jinyu Li, Scott Wisdom, John R. HersheyZenodo 2021 · DOI · OpenAlex

Abstract

<strong>Dataset</strong> This data repository contains separated audio streams for the LibriCSS dataset using the following window-based separation methods: 1. <em>Mask-based MVDR</em>: Takuya Yoshioka, Hakan Erdogan, Zhuo Chen, and Fil Alleva, “Multi-microphone neural speech separation for farfield multi-talker speech recognition,” ICASSP 2018. 2. <em>Sequential neural beamforming</em>: Zhong-Qiu Wang, Hakan Erdogan, Scott Wisdom, Kevin Wilson, Desh Raj, Shinji Watanabe, Zhuo Chen, and John R. Hershey, “Sequential multi-frame neural beamforming for speech separation and enhancement,” IEEE SLT 2021. These audio streams were used for evaluating the diarization and ASR models in our JSALT 2020 paper. The repository contains the following archive files: libricss_mvdr_2stream.tar.gz libricss_sequential_3stream.tar.gz <strong>Citation</strong> If you use these separated audio streams in your research, consider citing: <pre><code>@article{Raj2020IntegrationOS, title={Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis}, author={Desh Raj and Pavel Denisov and Z. Chen and H. Erdogan and Zili Huang and Mao-Kui He and Shinji Watanabe and Jun Du and T. Yoshioka and Yi Luo and N. Kanda and Jinyu Li and S. Wisdom and J. Hershey}, journal={2021 IEEE Spoken Language Technology (SLT) Workshop}, year={2021} }</code></pre> <br>
BibTeX
@inproceedings{raj2021integration,
  author = {Desh Raj and Pavel Denisov and Zhuo Chen and Hakan Erdoğan and Zili Huang and Maokui He and Shinji Watanabe and Jun Du and Takuya Yoshioka and Yi Luo and Naoyuki Kanda and Jinyu Li and Scott Wisdom and John R. Hershey},
  title = {{Integration of speech separation, diarization, and recognition for multi-speaker meetings: Separated LibriCSS dataset}},
  booktitle = {Zenodo},
  year = {2021},
  doi = {10.5281/zenodo.4415162},
}

Loading related content...

Figure