Compressing Transformer-Based ASR Model by Task-Driven Loss and Attention-Based Multi-Level Feature Distillation

Yongjie Lv, Longbiao Wang, Meng Ge, Sheng Li, Chenchen Ding, Lixin Pan, Yuguang Wang, Jianwu Dang, Kiyoshi HondaICASSP 2022 · DOI

BibTeX
@inproceedings{lv2022compressing,
  author = {Yongjie Lv and Longbiao Wang and Meng Ge and Sheng Li and Chenchen Ding and Lixin Pan and Yuguang Wang and Jianwu Dang and Kiyoshi Honda},
  title = {{Compressing Transformer-Based ASR Model by Task-Driven Loss and Attention-Based Multi-Level Feature Distillation}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2022},
  doi = {10.1109/icassp43922.2022.9746113},
}

Loading related content...

Figure