Hierarchical Multiple Granularity Attention Network for Long Document Classification

Yongli Hu, Wen Ding, Tengfei Liu, Junbin Gao, Yanfeng Sun, Baocai Yin

Abstract

Long document classification has aroused tremendous attention in the field of Nature Language Processing, due to the exponential increasing of publications. Although the common text classification methods can be extended for long document classification, they are confined to the length of text and do not have enough expressiveness to model the structure of the long document. To solve these problems, we proposed a hierarchical multiple granularity attention network for long document classification, in which the word and section level features are extracted and fused to represent the complex structure of the long document. Furthermore, a feature-based section pooling module is adopted to eliminate redundant text information and accelerate the computing. A series of experiments are conducted to evaluate the proposed method. The experimental results verify that our method is effective, efficient and competitive compared with the related state-of-the-art methods.
BibTeX
@inproceedings{hu2022hierarchical,
  author = {Yongli Hu and Wen Ding and Tengfei Liu and Junbin Gao and Yanfeng Sun and Baocai Yin},
  title = {{Hierarchical Multiple Granularity Attention Network for Long Document Classification}},
  booktitle = {IJCNN},
  year = {2022},
  doi = {10.1109/ijcnn55064.2022.9892046},
}

Loading related content...

Figure