Decoupling Content Planning from Surface Realization

1,088 concepts637 papers8 proposals

Standard large language models generate text autoregressively, predicting the next token based entirely on preceding tokens. While highly effective for short snippets, this approach breaks down over long horizons. Without a global strategy, models suffer from semantic drift, lose track of entity consistency, and accumulate errors exponentially. To write a 2,000-word story or a complex scientific report, a model cannot simply sprint word-by-word; it needs a map.

To solve this, researchers have converged on a hierarchical strategy: decoupling content planning from surface realization. Instead of generating the final text directly, the system first produces an intermediate, high-level structural representation—a blueprint—and then expands that blueprint into natural language.

The Core Mechanism: The Plan-Then-Write Paradigm

The fundamental insight behind hierarchical planning is that text generation involves two distinct cognitive challenges: deciding what to say (content selection) and deciding how to say it (surface realization). Autoregressive models struggle because they attempt to solve both problems simultaneously at every token step.

Early foundations by Gabor Angeli et al. in A Simple Domain-Independent Probabilistic Approach to Generation modeled generation as a hierarchical sequence of discrete decisions, moving from macro-level record selection to micro-level templates. In modern neural architectures, this concept manifests as a two-stage pipeline. For example, Hua Wu et al. demonstrated in Chinese Poetry Generation with Planning based Neural Network that pre-generating a sequence of sub-topic keywords mitigates semantic drift across multiple text segments. Similarly, Xiaoyuan Yi et al. utilized a modular framework in Generating Chinese Classical Poems with RNN Encoder-Decoder to pass the output of one planning stage as context for the next, preserving thematic consistency.

By establishing a structural roadmap before generating prose, the model effectively breaks a massive, high-dimensional generation task into manageable, localized sub-problems.

Why It Works: The Logical Buffer and Self-Correction

Decoupling content planning from surface realization fundamentally changes the dynamics of long-form generation through three core mechanisms:

1. Isolating Concerns to Reduce Hallucination

When a model is forced to extract facts and format them simultaneously, it often introduces factual errors. As Xiaojun Wan et al. show in Guiding Abstractive Dialogue Summarization with Content Planning, extracting a coarse semantic skeleton before expanding it isolates the extraction of key facts from their linguistic realization, preventing the model from hallucinating or losing track of "who did what to whom."

2. Persistent Reference and Self-Correction

An outline acts as a persistent anchor. Kevin Yang et al. demonstrate this in Re3: Generating Longer Stories With Recursive Reprompting and Revision. If a model drifts or becomes overly verbose during a specific chapter, subsequent prompts grounded in the initial global plan pull the narrative back on track. The plan serves as a self-correction mechanism that prevents local deviations from ruining global coherence.

3. Bounding the Permissible Space

Blueprints act as a logical buffer. Yu-Zhe Shi et al. formalize this in Constraint representation towards precise data-driven storytelling, using hierarchical constraints to bridge high-level narrative intent with low-level data evidence. This defines a "permissible space" for the output, ensuring the text remains both narratively coherent and factually grounded.

Structural Variations of the Blueprint

The "plan" is not always a simple bulleted list; its structure varies depending on the complexity of the target output:

Scaling to Complex, Long-Form Workflows

As tasks grow more sophisticated, hierarchical planning evolves from simple two-stage prompts into multi-stage agentic pipelines. For instance, Yijia Shao et al. developed STORM in Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Models, which uses a pre-writing phase of perspective discovery and outline refinement to generate comprehensive long-form articles section by section. In technical domains, the authors of AI-Researcher: Autonomous Scientific Innovation manage long-form technical writing via a three-phase process moving from structural outlining to template-guided drafting and final verification against academic checklists.

This paradigm extends seamlessly to multimodal domains. Han Zhang argues in StoryBench: A Multifaceted Benchmark for Continuous Story Visualization that decomposing full sequence generation into a hierarchy of tasks isolates entity consistency from initial scene synthesis.

Furthermore, Max Ku et al. show in TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understanding that decomposing complex video generation into discrete scene layouts allows for long-term planning and error correction. Similarly, Long Ling et al. in Sketchar: Supporting Character Design and Illustration Prototyping Using Generative AI transform unstructured descriptions into structured keywords before passing them to image generators, ensuring visual assets remain grounded in the intended narrative context.

History & citationVersion 2 · 2026-10-04

Current · Permanent link

  1. Version 2 (latest) · 2026-10-04 · 642 papers
  2. Version 1 · 2026-10-04 · 985 papers
Cite this direction

Latest version (a living page):

@misc{lacuna_hierarchical_narrative_planning_e998aeda,
  title = {hierarchical narrative planning},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/hierarchical-narrative-planning/rdr_e998aeda0e1c4488bc259a207bce884e},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}

This exact version (version 2, frozen text):

@misc{lacuna_hierarchical_narrative_planning_e998aeda_v2,
  title = {hierarchical narrative planning},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/hierarchical-narrative-planning/rdr_e998aeda0e1c4488bc259a207bce884e/v/2},
  note = {Version 2, frozen 2026-10-04. Accessed 2026-11-21},
}
About

These directions overlap with this one through shared papers.

See something wrong? Report a mistake