Creativity in AI: Progresses and Challenges

Mete Ismayilzada, Debjit Paul, Antoine Bosselut, Lonneke van der PlasarXiv 2024 · DOI · arXiv

Introduction

As generative AI becomes ubiquitous, a central question persists: Are these models truly creative, or are they merely "stochastic parrots" rearranging training data? This survey addresses the lack of a unified framework for evaluating machine creativity, distinguishing between high-quality interpolation (averaging known patterns) and genuine invention. By analyzing the current state of the art, we identify where AI has made genuine progress and where it hits a "creativity ceiling"—particularly in tasks requiring abstract reasoning, compositionality, and intentionality.

A Taxonomy of AI Creativity

To evaluate progress, we must define the dimensions of creativity. We synthesize research through several psychological and computational lenses: the Four-C Model (categorizing creativity from personal "mini-c" learning to world-changing "Big-C" genius), Boden’s Three Types (combinatorial, exploratory, and transformational), and a focus on Process vs. Product. Evaluating the internal logic and response pathways of a model is as critical as assessing its final output.

Taxonomy of AI creativity across domains, types, dimensions, and processes.

Domains and Benchmarks

AI creativity is tested across linguistic, artistic, problem-solving, and scientific domains. Key benchmarks include the Alternative Uses Task (AUT) for divergent thinking, the Abstraction and Reasoning Corpus (ARC) for fluid intelligence, and specialized datasets for humor, metaphor, and scientific discovery (e.g., AI Feynman for equation discovery).

Detailed map of datasets and methods across linguistic, problem-solving, artistic, and scientific creativity.

Key Insights: The Creativity Ceiling

Current AI excels at interpolation—filling gaps within known data distributions. However, it struggles with extrapolation and invention:

  • The "Einstellung" Effect: Models often exhibit functional fixedness, biased toward common associations (e.g., failing to see a shoe as a potential hammer because its training insists a shoe is for walking).
  • The "Salieri" Effect: LLM outputs tend to be more homogenous and less exceptional than human-written text. They are proficient at the "average" but struggle with the "exceptional."
  • Lack of Agency: AI lacks spontaneity and intentionality, creating only when prompted and following statistical probability rather than intentional divergence.

Empirical Results

  • The ARC Gap: On the Abstraction and Reasoning Corpus (ARC), the best AI models currently score around 49.5%, while the human-level threshold is 85%.
  • Idea Uniqueness: In large-scale studies of AI idea generation, only a tiny fraction of generated ideas (e.g., 5%) were found to be truly unique or original.
  • Compositional Failure: Models frequently fail at "negation" and "spatial relationships" in image generation (e.g., rendering "a bowl with fewer strawberries than cucumbers").

Future Directions

Overcoming the "creativity ceiling" requires addressing several grand challenges:

  1. Active Divergence: Designing architectures that intentionally move away from the most likely training distribution to find novel solutions.
  2. Semantic Planning: Moving beyond token-by-token prediction toward high-level planning to maintain long-range coherence in stories and scientific theories.
  3. Human-AI Collaboration: Developing "centaur" systems where AI acts as a creative assistant to human "Big-C" creators.
  4. Ethics and Copyright: Navigating the legal tensions of training on copyrighted works to produce "new" art.

Summary updated

Abstract

Creativity is the ability to produce novel, useful, and surprising ideas, and has been widely studied as a crucial aspect of human cognition. Machine creativity on the other hand has been a long-standing challenge. With the rise of advanced generative AI, there has been renewed interest and debate regarding AI's creative capabilities. Therefore, it is imperative to revisit the state of creativity in AI and identify key progresses and remaining challenges. In this work, we survey leading works studying the creative capabilities of AI systems, focusing on creative problem-solving, linguistic, artistic, and scientific creativity. Our review suggests that while the latest AI models are largely capable of producing linguistically and artistically creative outputs such as poems, images, and musical pieces, they struggle with tasks that require creative problem-solving, abstract thinking and compositionality and their generations suffer from a lack of diversity, originality, long-range incoherence and hallucinations. We also discuss key questions concerning copyright and authorship issues with generative models. Furthermore, we highlight the need for a comprehensive evaluation of creativity that is process-driven and considers several dimensions of creativity. Finally, we propose future research directions to improve the creativity of AI outputs, drawing inspiration from cognitive science and psychology.
BibTeX
@misc{ismayilzada2024creativity,
  author = {Mete Ismayilzada and Debjit Paul and Antoine Bosselut and Lonneke van der Plas},
  title = {{Creativity in AI: Progresses and Challenges}},
  year = {2024},
  eprint = {2410.17218},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2410.17218},
}

Loading related content...

Figure