A Separable Temporal Convolution Neural Network with Attention for Small-Footprint Keyword Spotting

Shenghua Hu, Jing Wang, Yujun Wang, Lidong Yang, Wenjing Yang

Abstract

Keyword spotting (KWS) on mobile devices generally requires a small memory footprint. However, most current models still maintain a large number of parameters in order to ensure good performance. To solve this problem, this paper proposes a separable temporal convolution neural network with attention, it has a small number of parameters. Through the time convolution combined with attention mechanism, a small number of parameters model (32.2K) is implemented while maintaining high performance. The proposed model achieves 95.7% accuracy on the Google Speech Commands dataset, which is close to the performance of Res15(239K), the state-of-the-art model in KWS at present.
BibTeX
@misc{hu2021separable,
  author = {Shenghua Hu and Jing Wang and Yujun Wang and Lidong Yang and Wenjing Yang},
  title = {{A Separable Temporal Convolution Neural Network with Attention for Small-Footprint Keyword Spotting}},
  year = {2021},
  eprint = {2109.00260},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2109.00260},
}

Loading related content...

Figure