Destructive creation, creative destruction, and the paradox of innovation science

Likun Cao, Ziwen Chen, James A. EvansSociology 2022

TL;DR

Innovation is a fundamental paradox: the moment it becomes predictable and institutionalized, it ceases to be an engine of true novelty. This paper reviews over a decade of social science research to argue that innovation arises from "destructive creation"—where disorder and conflict break down old structures—and spreads through "creative destruction," suggesting that our current scientific models have a massive "empirical hole" regarding how material, social, and cultural forces co-evolve.

What Problem Does This Paper Address?

The field of "innovation science" is currently a fragmented landscape. While thousands of papers are published annually across sociology, economics, and management, the literature is often "unnavigable" due to distinct vocabularies and disconnected focus areas.

More importantly, the authors tackle the Paradox of Innovation Science: if we successfully codify and predict the patterns of innovation, the subject itself disappears because innovation, by definition, must defy expectation. The authors seek to synthesize these disparate studies into a unified framework that explains how new things emerge (genesis) and how they replace the old (diffusion).

Methods

This paper is a systematic review and conceptual synthesis. The authors followed a three-step process to map the field:

  1. Initial Sampling: They identified the most highly cited journals across sociology, management, economics, political science, psychology, communication, and data science. They collected 1,679 articles published between 2011 and 2022 containing the keywords “innovation,” “invention,” or “creation.”
  2. Clustering and Filtering: They grouped papers by topic (e.g., team composition) and selected representative "influential" works, narrowing the set to approximately 120 papers.
  3. Augmentation: They added "classic" foundational works (like Rogers’ diffusion theory) and highly cited recent books to reach a final corpus of over 190 studies.

The authors then mapped these literatures onto a two-dimensional simplex anchored by three poles: Social, Material, and Cultural factors.

Datasets

As a review paper, it does not introduce a new experimental dataset. Instead, it utilizes the Web of Science for citation statistics and treats the corpus of 190+ social science articles as its primary object of analysis. The authors also reference large-scale digital data sources (like Facebook memes and patent records) used in the studies they review.

Key Insights and Ideas

  • Destructive Creation vs. Creative Destruction: The authors coin "destructive creation" to describe the genesis phase. Innovation often requires a "breach" in prior success—shocks like wars, natural disasters, or even internal cognitive conflict—to dislodge existing structures and allow for new recombinations. "Creative destruction" (a term popularized by Schumpeter) refers to the diffusion phase, where the new innovation renders the old obsolete.
  • The "Adjacent Possible": Borrowing from complexity science, the authors view innovation as a recursive process of recombination. Each new combination expands the "adjacent possible"—the space of possibilities just one step away from the current frontier.
  • The Empirical Hole: The authors identify a significant gap in the literature. Most social scientists focus on how social/cultural contexts influence material innovation (e.g., how a team's diversity leads to a new gadget). Very few studies look at the reverse—how material changes (like the internet or AI) fundamentally reshape social and cultural structures at scale.
  • The Burden of Knowledge: The paper highlights a troubling trend: as the total body of human knowledge grows, it takes longer for innovators to reach the frontier, leading to a decline in individual productivity and a shift toward more conservative, incremental research.

Key Results

  • Team Dynamics: Research shows that smaller, flatter teams are more likely to produce disruptive innovations because they foster "low-level cognitive conflict," whereas large teams tend to develop existing ideas.
  • Network Positions: Innovation capacity is often tied to "structural holes." Individuals or firms that act as brokers between disconnected groups have access to "dissonant information," which is a primary driver of novelty.
  • The S-Curve of Adoption: The authors synthesize various explanations for why innovation spreads in an S-shaped curve, ranging from "epidemic" models (information flow) to "probit" models (differences in adopter risk tolerance).
  • Declining Dynamism: The review notes that despite an explosion in the quantity of research, scientific progress has slowed. Citations increasingly flow to well-known researchers, making it harder for "outsiders" to challenge established field leaders.

Limitations and Future Work

The authors acknowledge that social science has a "contemporary bias" toward viewing social and cultural disorder as the primary driver of innovation, rather than seeing material forces as equal partners.

Future Directions: * Bridging the Gap: There is a call for "big innovation data" and computational tools (like NLP and generative models) to fill the "empirical hole" in the center of the Social-Material-Cultural triangle. * Co-evolutionary Models: Future research should treat social, material, and cultural forces as "co-constitutive," acknowledging that technological shifts (like AI) don't just happen in a society but fundamentally change that society's reasoning and structure. * Inspiration from Fiction: The authors suggest that "science studies" and "science fiction" have often been better at imagining the long-term, non-linear consequences of innovation than formal social science, providing a roadmap for future theoretical development.

Summary updated

Abstract

Innovation or the creation and diffusion of new material, social and cultural things in society has been widely studied in sociology and across the social sciences, with investigations sufficiently diverse and dispersed to make them unnavigable. This complexity results from innovation’s importance for society, but also the fundamental paradox underlying innovation science: When innovation becomes predictable, it ceases to be an engine of novelty and change. Here we review innovation studies and show that innovations emerge from contexts of discord and disorder, breaches in the structure of prior success, through a process we term destructive creation. This often leads to a complementary process of creative destruction whereby local structures protect and channel the diffusion of successful innovations, rendering alternatives obsolete. We find that social scientists naturally focus far more on how social and cultural contexts influence material innovations than the converse. We highlight computational tools that open new possibilities for the analysis of novel content and context in interaction, and show how this brings us empirically toward the broader range of possibilities that complex systems and science studies have theorized—and science fiction has imagined—the social, cultural and material structures of innovation conditioning each other’s change through cycles of disruption and development.
BibTeX
@inproceedings{cao2022destructive,
  author = {Likun Cao and Ziwen Chen and James A. Evans},
  title = {{Destructive creation, creative destruction, and the paradox of innovation science}},
  booktitle = {Sociology},
  year = {2022},
}
Figure