Fine-tune BERT with Sparse Self-Attention Mechanism

Baiyun Cui, Yingming Li, Ming Chen, Zhongfei ZhangEMNLP 2019 · DOI

BibTeX
@inproceedings{cui2019fine,
  author = {Baiyun Cui and Yingming Li and Ming Chen and Zhongfei Zhang},
  title = {{Fine-tune BERT with Sparse Self-Attention Mechanism}},
  booktitle = {Conference on Empirical Methods in Natural Language Processing},
  year = {2019},
  doi = {10.18653/v1/d19-1361},
}
Figure