Persistence Paradox in Dynamic Science

Honglin Bao, Kai LiarXiv 2025 · OpenReview

TL;DR

This paper challenges the conventional wisdom that persistence is always a virtue in science. It reveals that during periods of rapid paradigm shifts, like the deep learning revolution, rigid adherence to past research can lead to a "rigidity penalty" and a decline in scientific impact. Instead, strategic adaptation—selectively pivoting to new trends while retaining some prior expertise—is key to sustained success.

What Problem Does This Paper Address?

The scientific community often celebrates persistence as a core tenet of successful research. However, this paper questions whether this holds true in dynamic fields undergoing rapid paradigm shifts. Specifically, it investigates how scientists navigate such transformative periods, like the deep learning revolution that began around 2012, and whether their persistence in established research areas helps or hinders their long-term impact. The authors aim to understand the trade-offs between deep specialization and the need for adaptability in a rapidly evolving scientific landscape.

Methods

The researchers analyzed the career trajectories of over 5,000 scientists active in top machine learning venues in the decade preceding 2013. They employed a combination of macro-level and micro-level analyses.

  • Macro-level: They used TF-IDF to extract keywords from paper abstracts to track topical convergence and divergence across major conferences (ICML, NeurIPS, and ICLR) over time, demonstrating how the field's focus shifted.
  • Micro-level: They quantified "research persistence" by measuring the text similarity of a scientist's publications from one year to the next. They then used regression models with two-way fixed effects to analyze the relationship between persistence, adaptation, and academic success (productivity and impact, measured by citation percentile rank). Control variables included prior performance, collaborator count, collaborator familiarity, and collaborator status.

Datasets

The study utilized several datasets:

  • NeurIPS and ICML papers: All papers published in these top-tier machine learning conferences from 2003-2022 (10 years before and after the deep learning boom).
  • ICLR papers: Papers published from 2013-2022.
  • Microsoft Academic Graph (MAG): Approximately 579,973 papers categorized under "machine learning" or "deep learning" from 2003-2022 to provide a broader context.
  • Cohort of 5,359 scholars: Identified from ICML/NeurIPS papers between 2003-2012, their annual research output was tracked from 2003-2022.

Key Insights and Ideas

  • Persistence is context-dependent: The paper strongly argues that persistence, while often lauded, can be detrimental during paradigm shifts.
  • The "Rigidity Penalty": Scientists who rigidly adhered to their pre-existing research areas after the deep learning revolution experienced a decline in their scientific impact, even if their productivity remained stable.
  • Strategic Adaptation is Key: Scientists who strategically pivoted, integrating new deep learning concepts while retaining some of their prior expertise, reaped greater benefits in terms of impact.
  • Disruption as a Reconfigurator: Scientific breakthroughs act as powerful mechanisms that can reconfigure the power structures within a field, creating opportunities for those who adapt.
  • Team Dynamics Matter: Older and larger teams were found to be less adaptive, while newer collaborations and those with a mix of experienced and new members were more successful in navigating the shift.

Key Results

  • During the deep learning era, a 0.1 increase in research similarity to prior work was associated with a 1.77% marginal decrease in impact, holding other factors constant.
  • While persistence was positively associated with productivity both before and after the paradigm shift, it was negatively associated with impact in the post-2013 deep learning era.
  • Collaborating with high-status partners significantly enhanced influence, though it could negatively affect productivity due to the demands of maintaining those relationships.
  • The study found that while prior impact could suppress subsequent impact (suggesting a redistribution of influence), productivity showed a positive correlation with increased persistence.

Limitations and Future Work

  • Data Availability: The study primarily relied on published papers due to limitations in accessing submission data, especially for earlier years. Future work could explore submitted papers to capture adaptation during the review process.
  • Scope of Venues: The analysis focused on top-tier conferences (ICML, NeurIPS, ICLR). Future research could examine scientists publishing in venues that were slower to adopt the new paradigm.
  • Other Fields: The study focused on machine learning. Investigating similar dynamics in other scientific fields could provide broader insights.
  • Open Peer Review: The development of open peer review infrastructures might offer future opportunities to study adaptation during the review process itself.

Summary updated

Abstract

Persistence is often regarded as a virtue in science. In this paper, however, we challenge this conventional view by highlighting its contextual nature, particularly how persistence can become a liability during periods of paradigm shift. We focus on the deep learning revolution catalyzed by AlexNet in 2012. Analyzing the 20-year career trajectories of over 5,000 scientists who were active in top machine learning venues during the preceding decade, we examine how their research focus and output evolved. We first uncover a dynamic period in which leading venues increasingly prioritized cutting-edge deep learning developments that displaced relatively traditional statistical learning methods. Scientists responded to these changes in markedly different ways. Those who were previously successful or affiliated with old teams adapted more slowly, experiencing what we term a rigidity penalty - a reluctance to embrace new directions leading to a decline in scientific impact, as measured by citation percentile rank. In contrast, scientists who pursued strategic adaptation - selectively pivoting toward emerging trends while preserving weak connections to prior expertise - reaped the greatest benefits. Taken together, our macro- and micro-level findings show that scientific breakthroughs act as mechanisms that reconfigure power structures within a field.
BibTeX
@misc{bao2025persistence,
  author = {Honglin Bao and Kai Li},
  title = {{Persistence Paradox in Dynamic Science}},
  year = {2025},
  eprint = {2506.22729},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2506.22729},
}
Figure