Explicit Spatial Hint and Implicit Logits Relation: Distilling Heterogeneous Knowledge From Vision Transformer to CNN

Wenkuan Li, Dongyuan Li, Shuo Gao, Xubin Wu, Ming Li, Haifang LiICASSP 2025 · DOI

BibTeX
@inproceedings{li2025explicit,
  author = {Wenkuan Li and Dongyuan Li and Shuo Gao and Xubin Wu and Ming Li and Haifang Li},
  title = {{Explicit Spatial Hint and Implicit Logits Relation: Distilling Heterogeneous Knowledge From Vision Transformer to CNN}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2025},
  doi = {10.1109/icassp49660.2025.10889610},
}

Loading related content...

Figure