Learning Disentangled Feature Representations for Speech Enhancement Via Adversarial Training
Lists
Only you see this
Abstract
Neural speech enhancement degrades significantly in face of unseen noise. To address such mismatch, we propose to learn noise-agnostic feature representations by disentanglement learning, which removes the unspecified noise factor, while keeping the specified factors of variation associated with the clean speech. Specifically, a discriminator module is introduced to distinguish the type of noises, which is referred to as the disentangler. With the adversarial training strategy, a gradient reversal layer seeks to disentangle the noise factor and remove it from the feature representation. Experiment results show that the proposed approach achieves 5.8% and 5.2% relative improvements over the best baseline in terms of perceptual evaluation of the speech quality (PESQ) and segmental signal-to-noise ratio (SSNR), respectively. The ablation study indicates that the proposed disentangler module is also effective in other encoder-decoder-like structures.
BibTeX
@inproceedings{hou2021learning,
author = {Nana Hou and Chenglin Xu and Eng Siong Chng and Haizhou Li},
title = {{Learning Disentangled Feature Representations for Speech Enhancement Via Adversarial Training}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2021},
doi = {10.1109/icassp39728.2021.9413512},
}Loading related content...