From LLM Hallucinations to Inspiration in Creative Work

Xinrui Lin, Heyan Huang, Shuning Zhang, Qi Wang, Youchao Zhou, John VinesarXiv 2026 · arXiv

TL;DR

While LLM hallucinations are usually treated as bugs to be squashed, this paper argues they can be a powerful source of "computational imagination" for creative professionals. By analyzing real-world interactions, the authors present a framework for how practitioners judge, adapt, and "salvage" inspiration from AI errors, transforming incorrect outputs into novel creative directions.

What Problem Does This Paper Address?

In the world of Large Language Models (LLMs), "hallucination"—generating factually incorrect or instruction-defying content—is typically seen as a failure of reliability. However, for creative practitioners (designers, writers, researchers), an "error" is sometimes just an unexpected idea.

Prior research has noted that hallucinations can spark creativity, but we haven't understood the mechanics of this process. Why is one fabricated reference annoying while another is "eye-opening"? This paper tackles the gap between error detection and creative utility, exploring how practitioners navigate the tension between an LLM's unreliability and its potential as a "provocateur" in the creative process.

Methods

The authors conducted a retrospective qualitative study with 20 experienced LLM users across three domains: Research, Design, and Social Media Content Creation.

The study used a two-step approach:

  1. Color-Coding Task: Participants reviewed their own chat logs (from ChatGPT, DeepSeek, etc.) and identified 41 specific hallucination cases. They coded these as Green (prompted action/exploration), Yellow (interesting but not pursued), or Red (meaningless or unacceptable).
  2. Semi-Structured Interviews: The researchers interviewed participants to understand the "why" behind their judgments, how they responded to these errors, and how their trust in the AI shifted as a result.

The analysis distinguished between factual hallucinations (conflicting with real-world facts) and faithfulness hallucinations (violating user instructions or logic).

Datasets

This study did not use a standard machine learning benchmark. Instead, it utilized a qualitative dataset of 41 real-world hallucination cases volunteered by the participants from their actual work history.

Table 1. Participant demographics, creative work domains, self-rated LLM experience, and submitted hallucination cases ("Fact." denotes factual hallucination, "Faith." denotes faithfulness hallucination, and "–" indicates that no case was submitted for that color).

Key Insights and Ideas

  • Inspiration is Stage-Dependent: Hallucinations are far more likely to be seen as "inspiring" during early-stage ideation and brainstorming. During the execution or "finalizing" phase, the same errors are viewed as high-risk failures.
  • The "Salvage" Mindset: Practitioners often perform a "creative extraction." They might recognize a fact is false (e.g., a fabricated historical event) but keep the "creative structure" or "logic" of the error to use in a fictional script or a design concept.
  • Role-Differentiated Trust: Hallucinations don't just "lower trust" across the board. Instead, they cause users to "re-calibrate" what they trust the LLM for. A user might stop trusting the LLM as a "source of facts" but increase their trust in it as a "divergence partner" or "fuzzy search tool."
  • Core vs. Subjective Constraints: For instruction-following (faithfulness), inspiration only happens when the AI violates "subjective" preferences (like style) while respecting "core" constraints (like safety or fundamental project requirements).

Key Results

The paper introduces a Framework from Hallucination to Inspiration (summarized in Figure 1 of the paper), which maps three distinct routes for factual hallucinations:

  1. Route 1: The user is inspired by the possibility before even verifying if it's true.
  2. Route 2: The user tries to verify a fake claim and, in the process of searching, discovers real related materials that spark a new idea.
  3. Route 3: The user knows it's fake but retains the "unexpected creative elements" anyway.

The authors also propose several design recommendations for future LLMs:

  • Stage-Sensitive Control: An "Inspiration Mode" that allows for higher divergence during brainstorming but tightens adherence during execution.
  • Salvage Support: UI tools that allow users to "pin" a useful part of a hallucination while asking the model to correct the factual errors around it.
  • Differentiated Labeling: Moving beyond "this might be wrong" to labels like "speculation," "creative hypothesis," or "low-confidence inference."

Limitations and Future Work

The study's primary limitation is its small, specialized sample size (20 young professionals), which may not represent how general users or professionals in high-stakes fields (like medicine or law) interact with AI. Additionally, the study relies on retrospective recall, which can be subject to memory bias.

Future work suggests implementing the "salvage support" and "stage-sensitive control" features in real-world LLM interfaces to see if they actually improve creative outcomes while mitigating the risks of misinformation.

Summary updated

Abstract

Large language models (LLMs) can introduce unexpected ideas through hallucinations, yet little is known about when creative practitioners find these errors inspiring or how these judgments shape interactions. We conducted a retrospective qualitative study with 20 experienced practitioners in research, design, and social media content creation, thematically analyzing 41 hallucination cases and 20 semi-structured interviews. Our framework links inspiration judgments of hallucinations based on goal relevance, task stage, content adaptability, and type-specific factors to behaviors across not-inspired, inspired-by, and inspired-to states. We characterize downstream interaction consequences, showing how hallucination-inspired experiences vary across creative stages and reshape role-differentiated trust, and propose these consequences as a dimension of hallucination evaluation. Finally, we derive design recommendations for stage-sensitive control of divergence and adherence, user-defined constraint priorities, differentiated hallucination labels, and salvage support for preserving useful ideas while correcting errors. These contributions deepen HCI understanding of hallucinations and responsible LLM design in creative work.
BibTeX
@misc{lin2026from,
  author = {Xinrui Lin and Heyan Huang and Shuning Zhang and Qi Wang and Youchao Zhou and John Vines},
  title = {{From LLM Hallucinations to Inspiration in Creative Work}},
  year = {2026},
  eprint = {2611.12337},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.12337},
}
Figure