Distill-Quantize-Tune - Leveraging Large Teachers for Low-Footprint Efficient Multilingual NLU on Edge

Pegah Kharazmi, Zhewei Zhao, Clement Chung, Samridhi ChoudharyICASSP 2023 · DOI

BibTeX
@inproceedings{kharazmi2023distill,
  author = {Pegah Kharazmi and Zhewei Zhao and Clement Chung and Samridhi Choudhary},
  title = {{Distill-Quantize-Tune - Leveraging Large Teachers for Low-Footprint Efficient Multilingual NLU on Edge}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2023},
  doi = {10.1109/icassp49357.2023.10095536},
}

Loading related content...

Figure