Learning Label-Relational Output Structure for Adaptive Sequence Labeling

Keqing He, Yuanmeng Yan, Hong Xu, Sihong Liu, Zijun Liu, Weiran XuIJCNN 2020 · OpenReview

Abstract

Sequence labeling is a fundamental task of natural language understanding. Recent neural models for sequence labeling task achieve significant success with the availability of sufficient training data. However, in practical scenarios, entity types to be annotated even in the same domain are continuously evolving. To transfer knowledge from the source model pre-trained on previously annotated data, we propose an approach which learns label-relational output structure to explicitly capturing label correlations in the latent space. Additionally, we construct the target-to-source interaction between the source model M <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">S</inf> and the target model M <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">T</inf> and apply a gate mechanism to control how much information in M <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">S</inf> and M <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">T</inf> should be passed down. Experiments show that our method consistently outperforms the state-of-the-art methods with a statistically significant margin and effectively facilitates to recognize rare new entities in the target data especially.
BibTeX
@inproceedings{he2020learning,
  author = {Keqing He and Yuanmeng Yan and Hong Xu and Sihong Liu and Zijun Liu and Weiran Xu},
  title = {{Learning Label-Relational Output Structure for Adaptive Sequence Labeling}},
  booktitle = {IJCNN},
  year = {2020},
  url = {https://openreview.net/forum?id=LFczR94Sqqa},
}

Loading related content...

Figure