Introduction
Generating high-quality, detailed outlines is a critical precursor to successful long-form expository writing, such as Wikipedia entries. While Large Language Models (LLMs) excel at short-form content, they often struggle with the structural complexity and information density required for longer documents. Existing approaches frequently suffer from a "knowledge density gap," where outputs lack fine-grained detail, or a "retrieval-coherence dilemma," where facts are retrieved but lack logical flow.
To address these challenges, we introduce LOGIC, a novel framework that mimics the human writing process through imitative structural learning and iterative critical self-refinement.
Methodology: The LOGIC Pipeline
The LOGIC system employs a four-stage pipeline designed to ensure both logical coherence and information depth:
- Serial Planning: Rather than generating an entire outline in one pass, LOGIC drafts sections serially. This ensures each section maintains a continuous narrative thread by being aware of preceding content.
- Modular Premise Generation: The system establishes a "premise" across four dimensions—definition, background, events, and significance—serving as a structural "North Star."
- Imitative Retrieval: A key innovation where the model retrieves the outlines of related entities. By analyzing successful structures of similar topics, the model "imitates" professional organization.
- Critical Self-Refinement: A dedicated Critic Model provides specific feedback on drafts, which a Generation Model then uses to iteratively polish and deepen the content.
Experimental Evaluation
LOGIC was evaluated using two primary benchmarks:
- FreshWiki: A dataset of recent, high-quality Wikipedia articles.
- WikiOutline: A new, diverse dataset curated by the authors containing 80 "Good Article" status pages across categories like Characters, Events, Films, Disasters, and Places.
Key Results
LOGIC demonstrates significant improvements over state-of-the-art baselines such as STORM and OmniThink. Quantitative analysis reveals that LOGIC enhances organization scores by 22.85% and logicality by 16.19% on the FreshWiki dataset.
The "Depth" metric saw a substantial increase of 54.29% over direct generation, indicating that the refinement process effectively adds necessary detail. Human evaluators consistently preferred LOGIC’s outlines, citing superior knowledge density and a more expert-like tone.
Conclusion and Future Work
LOGIC successfully bridges the gap between raw fact retrieval and coherent long-form planning by prioritizing structural imitation and iterative refinement. While the process is computationally more intensive than single-pass generation, it allows smaller models (like Llama-3-8B) to rival the performance of much larger models like GPT-4o. Future work will explore Reinforcement Learning (RL) to further optimize efficiency and address challenges in maintaining reader interest and objectivity.
Summary updated