Windowing Models for Abstractive Summarization of Long Texts
Lists
Only you see this
Abstract
Neural summarization models have a fixed-size input limitation: if text length surpasses the model’s maximal input length, some document content (possibly summary-relevant) gets truncated. Independently summarizing windows of maximal input size disallows for information flow between windows and leads to incoherent summaries. We propose windowing models for neural abstractive summarization of (arbitrarily) long texts. We extend the sequence-to-sequence model augmented with pointer generator network by (1) allowing the encoder to slide over different windows of the input document and (2) sharing the decoder and retaining its state across different input windows. We explore two windowing variants: Static Windowing precomputes the number of tokens for the decoder to generate from each window (based on training corpus statistics); in Dynamic Windowing the decoder learns to emit a token signaling the shift to the next input window. Empirical results render our models effective in intended use-case: summarizing long texts with relevant content not bound to document beginning.
BibTeX
@inproceedings{schuller2021windowing,
author = {Leon Schüller and Florian Wilhelm and Nico Kreiling and Goran Glavas},
title = {{Windowing Models for Abstractive Summarization of Long Texts}},
booktitle = {ECIR},
year = {2021},
doi = {10.1007/978-3-030-72240-1\_39},
}Loading related content...