KS-Net: Multi-band joint speech restoration and enhancement network for 2024 ICASSP SSI Challenge

Guochen Yu, Runqiang Han, Chenglin Xu, Haoran Zhao, Nan Li, Chen Zhang, Xiguang Zheng, Chao Zhou, Qi Huang, Bing Yu

Abstract

This paper presents the speech restoration and enhancement system created by the 1024K team for the ICASSP 2024 Speech Signal Improvement (SSI) Challenge. Our system consists of a generative adversarial network (GAN) in complex-domain for speech restoration and a fine-grained multi-band fusion module for speech enhancement. In the blind test set of SSI, the proposed system achieves an overall mean opinion score (MOS) of 3.49 based on ITU-T P.804 and a Word Accuracy Rate (WAcc) of 0.78 for the real-time track, as well as an overall P.804 MOS of 3.43 and a WAcc of 0.78 for the non-real-time track, ranking 1st in both tracks.
BibTeX
@misc{yu2024ks,
  author = {Guochen Yu and Runqiang Han and Chenglin Xu and Haoran Zhao and Nan Li and Chen Zhang and Xiguang Zheng and Chao Zhou and Qi Huang and Bing Yu},
  title = {{KS-Net: Multi-band joint speech restoration and enhancement network for 2024 ICASSP SSI Challenge}},
  year = {2024},
  eprint = {2402.01808},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2402.01808},
}
Figure