BirdSoundsDenoising: Deep Visual Audio Denoising for Bird Sounds

Youshan Zhang, Jialu Li

Abstract

Audio denoising has been explored for decades using both traditional and deep learning-based methods. However, these methods are still limited to either manually added artificial noise or lower denoised audio quality. To overcome these challenges, we collect a large-scale natural noise bird sound dataset. We are the first to transfer the audio denoising problem into an image segmentation problem and propose a deep visual audio denoising (DVAD) model. With a total of 14,120 audio images, we develop an audio ImageMask tool and propose to use a few-shot generalization strategy to label these images. Extensive experimental results demonstrate that the proposed model achieves state-of-the-art performance. We also show that our method can be easily generalized to speech denoising, audio separation, audio enhancement, and noise estimation.
BibTeX
@inproceedings{zhang2023birdsoundsdenoising,
  author = {Youshan Zhang and Jialu Li},
  title = {{BirdSoundsDenoising: Deep Visual Audio Denoising for Bird Sounds}},
  booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
  year = {2023},
  doi = {10.1109/wacv56688.2023.00228},
}
Figure