Syntactic Sentence Compression via Tree Pruning

This direction is merged into another direction: dependency-constrained compression. Its last version stays readable and citable here.

Version 1 of 117 papers24 conceptsfrozen 2026-10-04

When we summarize a document, we often face a strict word budget. The simplest way to save space is to delete words, but deleting words at random quickly turns a coherent thought into "word salad." To shorten a sentence while keeping it readable, we must respect its underlying architecture.

Researchers have converged on a powerful solution: treating sentence compression as a structural pruning problem on a linguistic parse tree. By identifying the "grammatical skeleton" of a sentence, systems can discard modifiers and redundant clauses while ensuring the remaining text remains a valid, logical unit.

The Sentence as a Tree

The core intuition behind this research is that sentences are not linear strings of tokens, but hierarchical structures. Most work in this area, such as that by Liqun Shao in the DTATG system, relies on dependency trees. In these trees, words are nodes, and edges represent grammatical relationships (like a subject belonging to a verb).

If you delete a word in the middle of a string, you might break the sentence. But if you prune a "leaf" or a sub-branch from a dependency tree, the rest of the tree remains connected. Peng Li and Yinglin Wang demonstrated that pruning based on these relations—such as removing clausal complements or parataxis—ensures that the compressed text remains grammatically readable compared to simple word-level deletion [SJTU CIT at TAC 2010].

Preserving the Grammatical Core

How do we decide what to keep? The consensus across these papers is to prioritize the Subject-Verb-Object (SVO) core. Hongyan Liu and colleagues describe this as identifying the "grammatical core" through dependency parsing to prune extraneous modifiers while maintaining the primary meaning [The CIST Summarization System at TAC 2010].

However, a "one-size-fits-all" pruning rule can be too rigid. Different contexts require different levels of detail:

Head-Driven and Weighted Pruning

To prevent "orphaned" words—modifiers that remain after their head word has been deleted—researchers like Lu Wang developed head-driven pruning. This approach links the removal of modifiers to their respective head nodes in the syntax tree, ensuring that if a "branch" is cut, all its "twigs" go with it [A Sentence Compression Based Framework to Query-Focused Multi-Document Summarization].

We can also guide the pruning process using external "importance" signals. Zhongyu Wei and Wei Gao showed that by adjusting the weights of edges in a dependency tree based on real-time social media signals (like tweets), a model can be "nudged" to retain specific entities that are currently trending, even if they aren't the primary grammatical subject [Using Tweets to Help Sentence Compression].

From Summaries to LLM Prompts

While early work focused on news summarization, the same structural intuition is now being applied to Large Language Models (LLMs). As context windows become a bottleneck, researchers are looking for ways to compress long prompts without losing the "human logic" required for reasoning.

The PartPrompt system by Wenhao Mao and Ke Tang treats prompt compression as a tree-pruning problem. By using linguistic parse trees to guide the removal of tokens, they prevent the semantic fragmentation that occurs with unstructured deletion. This ensures that the logical flow of the instructions remains intact, allowing the model to reason effectively even with a fraction of the original text [Parse Trees Guided LLM Prompt Compression].

Papers in this version

History & citationVersion 1 · 2026-10-04

Merged into another direction · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_syntactic_sentence_compression_via_tree__6c372aa5,
  title = {Syntactic Sentence Compression via Tree Pruning},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/syntactic-sentence-compression-via-tree-pruning/rdr_6c372aa5430942db8dd18e59f5c52385},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}

This exact version (version 1, frozen text):

@misc{lacuna_syntactic_sentence_compression_via_tree__6c372aa5_v1,
  title = {Syntactic Sentence Compression via Tree Pruning},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/syntactic-sentence-compression-via-tree-pruning/rdr_6c372aa5430942db8dd18e59f5c52385/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}