Heterogeneous Student Knowledge Distillation From BERT Using a Lightweight Ensemble Framework

Ching-Sheng Lin, Chung-Nan Tsai, Jung-Sing Jwo, Cheng-Hsiung Lee, Xin WangIEEE Access 2024 · DOI

BibTeX
@article{lin2024heterogeneous,
  author = {Ching-Sheng Lin and Chung-Nan Tsai and Jung-Sing Jwo and Cheng-Hsiung Lee and Xin Wang},
  title = {{Heterogeneous Student Knowledge Distillation From BERT Using a Lightweight Ensemble Framework}},
  journal = {IEEE Access},
  year = {2024},
  doi = {10.1109/access.2024.3372568},
}

Loading related content...

Figure