How is BERT surprised? Layerwise detection of linguistic anomalies

Bai Li, Zining Zhu, Guillaume Thomas, Yang Xu, Frank Rudzicz

Abstract

Bai Li, Zining Zhu, Guillaume Thomas, Yang Xu, Frank Rudzicz. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
BibTeX
@inproceedings{li2021how,
  author = {Bai Li and Zining Zhu and Guillaume Thomas and Yang Xu and Frank Rudzicz},
  title = {{How is BERT surprised? Layerwise detection of linguistic anomalies}},
  booktitle = {Annual Meeting of the Association for Computational Linguistics},
  year = {2021},
  doi = {10.18653/v1/2021.acl-long.325},
}
Figure