Hierarchical Inter-Attention Network for Document Classification with Multi-Task Learning

Bing Tian, Yong Zhang, Jin Wang, Chunxiao Xing

Abstract

Document classification is an essential task in many real world applications. Existing approaches adopt both text semantics and document structure to obtain the document representation. However, these models usually require a large collection of annotated training instances, which are not always feasible, especially in low-resource settings. In this paper, we propose a multi-task learning framework to jointly train multiple related document classification tasks. We devise a hierarchical architecture to make use of the shared knowledge from all tasks to enhance the document representation of each task. We further propose an inter-attention approach to improve the task-specific modeling of documents with global information. Experimental results on 15 public datasets demonstrate the benefits of our proposed model.
BibTeX
@inproceedings{tian2019hierarchical,
  author = {Bing Tian and Yong Zhang and Jin Wang and Chunxiao Xing},
  title = {{Hierarchical Inter-Attention Network for Document Classification with Multi-Task Learning}},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year = {2019},
  doi = {10.24963/ijcai.2019/495},
}

Loading related content...

Figure