Document-Level Text Simplification

54 concepts42 papers1 proposal

Imagine reading an essay where every individual sentence is perfectly simple, yet the overall text feels completely disjointed. You encounter pronouns with no clear targets, sudden jumps in logic, and an erratic narrative flow.

This is the fundamental pitfall of traditional automatic text simplification. For years, natural language processing treated simplification as a sentence-by-sentence translation task. However, language operates on a global scale. True simplification requires looking beyond the sentence boundary to preserve the cohesive thread of a document.

The Sentence-Level Breakdown

When a model simplifies a sentence in isolation, it lacks the context of the surrounding discourse. This blind spot introduces several critical failures across a text:

The Mechanics of Document-Level Operations

Document-level simplification isn't just sentence simplification with a larger context window; it introduces entirely new editing operations that are fundamentally impossible at the sentence level.

Sentence-Level (1-to-1):
[Complex Sentence A] -------> [Simple Sentence A]
[Complex Sentence B] -------> [Simple Sentence B]

Document-Level (Many-to-Many & Global Curation):
[Complex Sentence A] ---\---> [Merged & Simplified Sentence AB]
[Complex Sentence B] ---/
[Complex Sentence C] -------> [Deleted (Globally Non-Essential)]

Information Redistribution and Merging

Professional editors rarely translate sentences one-to-one. Instead, they perform complex many-to-many transformations—merging ideas from multiple sentences or moving content across paragraph boundaries to improve clarity. Sofia Blinova et al. address this in SIMSUM: Document-level Text Simplification via Simultaneous Summarization by combining summarization and simplification to handle content reordering and structural transformations.

Strategic Content Deletion

To reduce cognitive load, non-essential background information must be pruned. However, determining what is "safe to delete" requires a global understanding of the text's core message. Bohan Zhang et al. showed in Predicting Sentence Deletions for Text Simplification Using a Functional Discourse Structure that incorporating the functional discourse structure of a document significantly improves a model's ability to predict which sentences to delete, while Reno Kriz et al. emphasize in Complexity-Weighted Loss and Diverse Reranking for Sentence Simplification that surrounding discourse is vital to ensure deletions do not compromise essential meaning.

New Benchmarks and Evaluation Paradigms

To transition the field toward holistic document processing, researchers have developed new datasets and metrics that move away from rigid sentence-to-sentence comparisons.

Document-Scale Corpora

Datasets like SWiPE (Philippe Laban et al. in SWiPE: A Dataset for Document-Level Simplification of Wikipedia Pages), D-Wikipedia (Renliang Sun et al. in Document-Level Text Simplification: Dataset, Criteria and Baseline), and VTechAGP (Ming Cheng et al. in VTechAGP: An Academic-to-General-Audience Text Paraphrase Dataset and Benchmark Models) capture real-world human editing strategies. These include paragraph restructuring, background elaboration, and the preservation of scientific narratives across full technical abstracts.

Context-Aware Evaluation

Traditional metrics like SARI evaluate text locally, often penalizing models when content is simply relocated rather than deleted. Ashwin Devaraj et al. demonstrated in Evaluating Factuality in Text Simplification that sentence-level evaluation frequently misidentifies valid information redistribution as factual errors.

To fix this, learnable metrics like LENS (Mounica Maddela et al. in LENS: A Learnable Evaluation Metric for Text Simplification) and human reading comprehension frameworks (Sweta Agrawal et al. in Do Text Simplification Systems Preserve Meaning? A Human Evaluation via Reading Comprehension) are being used to measure how well meaning, factual integrity, and coherence are preserved across entire paragraphs and documents.

Key Foundational Work

Text simplification for language learners: a corpus analysis (2007) — contributed 2 concept elements to this direction.
Experimenting with the Interaction between Aggregation and Text Structuring (2000) — contributed 1 concept elements to this direction.
History & citationVersion 1 · 2026-10-04

Current · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_document_level_text_simplification_9c95431c,
  title = {document-level text simplification},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/document-level-text-simplification/rdr_9c95431c0de4460aa1eb1cd93680ab92},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}

This exact version (version 1, frozen text):

@misc{lacuna_document_level_text_simplification_9c95431c_v1,
  title = {document-level text simplification},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/document-level-text-simplification/rdr_9c95431c0de4460aa1eb1cd93680ab92/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}
About

These directions overlap with this one through shared papers.

See something wrong? Report a mistake