Learning to Detect Verbose Expressions in Spoken Texts

Qingbin Liu, Shizhu He, Kang Liu, Shengping Liu, Jun Zhao

Abstract

The analysis and understanding of spoken texts is an important task in artificial intelligence and natural language processing. However, there are many verbose expressions (such as mantras, nonsense, modal particle, etc.) in spoken texts, which brings great challenges to subsequent tasks. This paper devote to detect verbose expressions in spoken texts. Considering the correlation of verbose words/characters in spoken texts, we adapt sequence models to detect them with an end-to-end manner. Moreover, we propose a model with the long-short term memory (LSTM) and modified restrict attention (MRA) mechanism which are able to utilize the mutual influence between long-distance and local words in sentences. In addition, we propose a compare mechanism to model the repetitive verbose expressions. The experimental result shows that compared with the rule-based and direct classification methods, our proposed model increases F1 measure by 54.08% and 18.91%.
BibTeX
@inproceedings{liu2018learning,
  author = {Qingbin Liu and Shizhu He and Kang Liu and Shengping Liu and Jun Zhao},
  title = {{Learning to Detect Verbose Expressions in Spoken Texts}},
  booktitle = {CCL},
  year = {2018},
  doi = {10.1007/978-3-030-01716-3\_30},
}

Loading related content...

Figure