Implementing a "publish, then review" model of publishing

Michael B. Eisen, Anna Akhmanova, Timothy E.j. Behrens, Diane M. Harper, Detlef Weigel, Mone ZaidieLife 2020 · DOI

TL;DR

eLife is transitioning to a "publish, then review" model, exclusively reviewing preprints and focusing on producing public reviews. This shift aims to make scientific publishing more efficient, transparent, and aligned with the internet age, moving away from traditional journal-centric evaluation.

What Problem Does This Paper Address?

The traditional academic publishing model, developed in the era of print, involves a lengthy process of "review, then publish." This often leads to significant delays between a researcher completing their work and it becoming publicly accessible. Furthermore, the emphasis on journal titles as a primary measure of research quality can create a "popularity contest" and hinder the dissemination of valuable findings that might not fit established journal scopes or face reviewer bias. The rise of preprints has created an opportunity to fundamentally rethink this process, making research more immediately available and shifting the focus from journal prestige to the quality of the research itself and its peer review.

Methods

The core methodological shift described is the transition to a "publish, then review" workflow. This involves:

  • Exclusive Preprint Review: eLife will only consider manuscripts that have already been posted as preprints on servers like bioRxiv or medRxiv. For manuscripts not yet on a preprint server, eLife will post them on the authors' behalf. While there's a temporary opt-out period for authors with concerns, the long-term goal is to make preprint posting mandatory.
  • Focus on Public Reviews: The editorial process will be reoriented to produce public reviews. This means reviewers and editors will be instructed to write reviews intended for a public audience, capturing what should and should not be included.
  • Curation over Gatekeeping: While eLife will still select a subset of papers for "publication" (essentially a curated badge of quality), the primary focus shifts from deciding if a paper should be published to transforming preprints into "refereed preprints" with public assessments.

Datasets

Not discussed in the paper.

Key Insights and Ideas

  • The Internet Age Demands a New Model: The traditional "review, then publish" model is an artifact of the printing press and is no longer optimal in the internet age, where immediate dissemination is possible.
  • Preprints are the Foundation: Preprints have matured to the point where they can serve as the primary platform for scientific communication, with peer review acting as a layer of validation and curation on top.
  • Transparency is Key: Making reviews public is crucial for improving the quality and utility of peer review, benefiting authors, readers, and the broader scientific community.
  • Shifting Evaluation Metrics: The long-term vision is to move away from journal titles as the primary measure of research quality, fostering a system that values the research itself and its robust evaluation.
  • Community Buy-in is Essential: Successful implementation requires careful consideration of author concerns and a gradual transition to ensure the entire scientific community can adapt to this new paradigm.

Key Results

The paper outlines a policy change rather than presenting quantitative results from a completed study. The "results" are the implementation of new editorial processes and policies:

  • Immediate Shift: Starting immediately, eLife is instructing editors and reviewers to prepare public reviews for all manuscripts under consideration.
  • Review Template and Instructions: A new review template and updated instructions for reviewers have been created to guide the production of public reviews.
  • Phased Preprint Adoption: A six-month period will allow authors to opt out of preprint posting, after which it will become the default.
  • Public Review Posting: For accepted papers, public reviews will be posted to preprint servers within three weeks. For rejected papers, authors can postpone posting until publication elsewhere, addressing concerns about career impact.

Limitations and Future Work

  • Author Concerns about Preprints: eLife acknowledges that some authors have concerns about posting preprints and is taking steps to understand and mitigate these.
  • Career Impact of Journal Citations: The reliance on journal titles for career advancement is a significant hurdle. While eLife aims to move away from this, they will continue to select papers for "publication" in the interim.
  • Developing Public Review Quality: The process of creating high-quality public reviews is still being refined, and eLife plans to work closely with its community to improve this.
  • Long-Term Vision: The ultimate goal is to break free from the "one paper, one journal, one publication model" and develop richer evaluation metrics and platforms for interacting with preprints and reviews. They are developing a new platform for this purpose (https://sciety.org/).
  • Ensuring Fairness and Avoiding Bias: eLife is committed to observing the impact of these changes and fighting for improvements to research communication, ensuring the evaluation process remains fair and free of bias.

Summary updated

Abstract

From July 2021 eLife will only review manuscripts already published as preprints, and will focus its editorial process on producing public reviews to be posted alongside the preprints.
BibTeX
@inproceedings{eisen2020implementing,
  author = {Michael B. Eisen and Anna Akhmanova and Timothy E.J. Behrens and Diane M. Harper and Detlef Weigel and Mone Zaidi},
  title = {{Implementing a "publish, then review" model of publishing}},
  booktitle = {eLife},
  year = {2020},
  doi = {10.7554/elife.64910},
}
Figure