Eliminating Agentic Workflow for Introduction Generation with Parametric Stage Tokens

Meicong Zhang, Tiancheng Su, Guoxiu HeSubmission to ICLR 2026 · Rejected

TL;DR

Researchers have developed STIG (Stage Token for Introduction Generation), a method that eliminates the need for complex, multi-step "agentic workflows" when writing scientific paper introductions. By embedding specialized "stage tokens" directly into a Large Language Model's (LLM) parameters, STIG allows for the generation of structured, logically coherent introductions in a single inference pass—improving efficiency by over 3x while outperforming traditional multi-agent systems.

What Problem Does This Paper Address?

Current AI-driven academic writing usually relies on agentic workflows. These systems break a task down into steps (e.g., "Agent A writes an outline," "Agent B drafts a paragraph," "Agent C reviews it"). While this sounds organized, it creates several headaches:

  1. Error Accumulation: If the first agent makes a mistake, every subsequent agent builds upon that error (cascading failure).
  2. High Overhead: Multi-turn interactions and repeated API calls are slow and expensive.
  3. Structural Drift: Agents often lose the "big picture," leading to introductions that lack a rigorous logical flow or omit critical details like experimental results.

Writing a research introduction is particularly difficult because it isn't just a summary; it’s a persuasive narrative that must bridge the gap between broad background and specific technical contributions.

Methods

The authors introduce Parametric Stage Tokens. Instead of using external scripts to manage the writing process, they "internalize" the workflow logic into the model itself.

  • The Tokens: They defined eight pairs of special tokens (from <STAGE0> to <STAGE7> and their corresponding <END> tags).
  • The Structure: These tokens correspond to four core subsections of a standard introduction:
  • Background
    1. Problem Statement & Limitations
    2. Methodological Overview & Results
    3. Research Contributions
  • The Process: For each subsection, the model first generates an Outline (even-numbered stages) and then the Content (odd-numbered stages).
  • Instruction Tuning: The researchers fine-tuned open-source backbones (Qwen2.5-7B and Llama3.1-8B) using Supervised Fine-Tuning (SFT). This taught the model the mapping between these tokens and their specific logical functions.

During inference, the model generates the entire sequence—tokens and all—in one go. The final introduction is then produced by simply parsing out the content between the stage tokens.

Datasets

  • ACL Dataset: The primary dataset consists of over 3,800 papers from the ACL (Association for Computational Linguistics) 2021–2025 conferences.
  • Test Set: 1,176 papers from the ACL 2025 Main Conference were used for evaluation.
  • Generalization Set: To see if STIG works outside of linguistics, they tested it on 102 CVPR papers (Computer Vision).
  • Annotation: They used GPT-4o to parse existing introductions into the required eight-stage format to create high-quality training data.

Key Insights and Ideas

  • Workflow Compression: The most significant insight is that the "logic" of a multi-step workflow can be compressed into a model's parameters. You don't need a complex pipeline if the model understands the temporal logic of the task.
  • Outline-to-Content Synergy: By forcing the model to generate an outline immediately before the content within the same inference stream, the model maintains better "structural rationality." The outline acts as a local anchor for the text that follows.
  • Efficiency vs. Complexity: The results suggest that for structured text generation, a single specialized model is often superior to a "committee" of general-purpose agents.

Key Results

  • Efficiency: STIG achieved a computational efficiency 3.3 times higher than agentic workflows like AutoSurvey, primarily by reducing total token consumption and eliminating multi-turn latency.
  • Structural Rationality (SR): STIG outperformed baselines by up to 17.4% in structural rationality. It was far less likely to mix up sections or repeat itself compared to multi-agent systems.
  • Human Preference: In a blind study, expert researchers ranked STIG-generated introductions as the highest quality, beating out both pure prompting and complex agentic baselines.
  • Generalization: Even when trained on ACL data and tested on CVPR (Vision) data, STIG maintained robust performance, suggesting the "logic" of a scientific introduction is somewhat universal across CS domains.

Limitations and Future Work

  • Domain Specificity: The model was trained primarily on Computer Science papers. Its performance in highly different fields (like Biology or History) where introduction structures vary remains unproven.
  • Annotation Dependency: The system relies on high-quality, structured training data. If the initial parsing/annotation is inconsistent, the model's output will suffer.
  • Hallucination Risk: Like all LLMs, STIG can still fabricate details. The authors emphasize that these tools should be used for drafting, and human sentence-by-sentence verification remains "irreplaceable."
  • Future Work: The authors suggest expanding the dataset to more diverse academic fields and exploring whether this "parametric stage" approach can be applied to other complex document types beyond research papers.

Summary updated

Abstract

In recent years, using predefined agentic workflows to guide large language models (LLMs) for literature classification and review has become a research focus. However, writing research introductions is more challenging. It requires rigorous logic, coherent structure, and abstract summarization. Existing workflows often suffer from long reasoning chains, error accumulation, and reduced textual coherence. To address these limitations, we propose eliminating external agentic workflows. Instead, we directly parameterize their logical structure into the LLM. This allows the generation of a complete introduction in a single inference. To this end, we introduce the Stage Token for Introduction Generation (STIG). STIG converts the multiple stages of the original workflow into explicit stage signals. These signals guide the model to follow different logical roles and functions during generation. Through instruction tuning, the model learns the mapping between stage tokens and text functions. It also learns the logical order and transition patterns between stages, encoding this knowledge into the model parameters. Experimental results show that STIG can generate multi-stage text in a single inference. It does not require explicit workflow calls. STIG outperforms traditional agentic workflows and other baselines on metrics of semantic similarity and sentence-level structural rationality. The code is provided in the Supplementary Materials.
BibTeX
@misc{zhang2025eliminating,
  author = {Meicong Zhang and Tiancheng Su and Guoxiu He},
  title = {{Eliminating Agentic Workflow for Introduction Generation with Parametric Stage Tokens}},
  year = {2025},
  eprint = {2601.09728},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2601.09728},
}
Figure