Simple Attention Module based Speaker Verification with Iterative noisy label detection
Lists
Only you see this
Abstract
Recently, the attention mechanism such as squeeze-and-excitation module (SE) and convolutional block attention module (CBAM) has achieved great success in deep learning-based speaker verification system. This paper introduces an alternative effective yet simple one, i.e., simple attention module (SimAM), for speaker verification. The SimAM module is a plug-and-play module without extra modal parameters. In addition, we propose a noisy label detection method to iteratively filter out the data samples with a noisy label from the training data, considering that a large-scale dataset labeled with human annotation or other automated processes may contain noisy labels. Data with the noisy label may over parameterize a deep neural network (DNN) and result in a performance drop due to the memorization effect of the DNN. Experiments are conducted on VoxCeleb dataset. The speaker verification model with SimAM achieves the 0.675% equal error rate (EER) on VoxCeleb1 original test trials. Our proposed iterative noisy label detection method further reduces the EER to 0.643%.
BibTeX
@inproceedings{qin2022simple,
author = {Xiaoyi Qin and Na Li and Chao Weng and Dan Su and Ming Li},
title = {{Simple Attention Module based Speaker Verification with Iterative noisy label detection}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2022},
doi = {10.1109/icassp43922.2022.9746294},
}Loading related content...