Retraction Note: Eye tracking: empirical foundations for a minimal reporting guideline

Kenneth Holmqvist, Saga Lee Örbom, Ignace T. C. Hooge, Diederick C. Niehorster, Robert G. Alexander, Richard Andersson, Jeroen S. Benjamins, Pieter Blignaut, Anne-Marie Brouwer, Lewis L. Chuang, Kirsten A. Dalrymple, Denis Drieghe, Matt J. Dunn, Ulrich Ettinger, Susann Fiedler, Tom Foulsham, Jos N. van der Geest, Dan Witzner Hansen, Samuel B. Hutton, Enkelejda Kasneci, Alan Kingstone, Paul C. Knox, Ellen M. Kok, Helena Lee, Joy Yeonjoo Lee, Jukka Leppänen, Stephen L. Macknik, Päivi Majaranta, Susana Martínez‐Conde, Antje Nuthmann, Marcus Nyström, Jacob Lund Orquin, Jorge Otero‐Millan, Soon Young Park, Stanislav Popelka, Frank A. Proudlock, Frank Renkewitz, Austin Roorda, Michael Schulte‐Mecklenbeck, Bonita Sharif, Frederick Shic, Mark Shovman, Mervyn G. Thomas, Ward Venrooij, Raimondas Zemblys, Roy S. HesselsBehavior 2023 · DOI · OpenAlex

Abstract

This document serves as a formal retraction of the 2022 article "Eye tracking: empirical foundations for a minimal reporting guideline," published in the journal Behavior Research Methods. The retraction was necessitated by the discovery that key empirical claims were supported by inappropriate citations, specifically two references that did not provide the intended support.

Introduction

In late 2023, the eye-tracking research community saw the retraction of a significant effort to standardize the field. The original 2022 paper was a high-profile attempt to establish a "minimal reporting guideline"—a checklist designed to solve the reproducibility crisis by ensuring researchers provide essential hardware and software details in their publications. However, the integrity of these guidelines was compromised by errors in the supporting literature.

The CrossMark 'Check for updates' icon is a standard tool in digital publishing to alert readers to retractions and corrections.

Reason for Retraction

The retraction note identifies that several statements in the original article relied on two specific references—Holmqvist (2015) and Holmqvist (2016)—which the authors and journal deemed inappropriate for supporting the article's claims. This misuse of citations undermined the "empirical foundations" upon which the reporting guidelines were built, leading to the decision that the paper could no longer stand as part of the valid scientific record.

Community Consensus

The retraction is notable for the broad consensus among its contributors. Forty-six co-authors, representing a global cross-section of the eye-tracking field, agreed to the retraction. The note also acknowledges that the lead author, Kenneth Holmqvist, is deceased. In academic publishing, the death of a lead author often makes a full retraction the most definitive path to maintaining the record's accuracy when revisions are no longer feasible.

Implications and Future Outlook

The removal of the 2022 guidelines (Volume 55, pages 364–416) leaves a significant void in the field's quest for standardization. While this is a setback for reproducibility efforts, the retraction highlights the critical importance of citation integrity in establishing scientific standards.

Future work will likely involve a new coalition of researchers attempting to rebuild these guidelines from the ground up. This process will require ensuring that every claim is anchored by robust, peer-reviewed, and accurately applied empirical evidence. Researchers in the field are encouraged to look for updated consensus statements that may emerge to replace the retracted 2022 framework.

Summary updated

BibTeX
@inproceedings{holmqvist2023retraction,
  author = {Kenneth Holmqvist and Saga Lee Örbom and Ignace T. C. Hooge and Diederick C. Niehorster and Robert G. Alexander and Richard Andersson and Jeroen S. Benjamins and Pieter Blignaut and Anne-Marie Brouwer and Lewis L. Chuang and Kirsten A. Dalrymple and Denis Drieghe and Matt J. Dunn and Ulrich Ettinger and Susann Fiedler and Tom Foulsham and Jos N. van der Geest and Dan Witzner Hansen and Samuel B. Hutton and Enkelejda Kasneci and Alan Kingstone and Paul C. Knox and Ellen M. Kok and Helena Lee and Joy Yeonjoo Lee and Jukka Leppänen and Stephen L. Macknik and Päivi Majaranta and Susana Martínez‐Conde and Antje Nuthmann and Marcus Nyström and Jacob Lund Orquin and Jorge Otero‐Millan and Soon Young Park and Stanislav Popelka and Frank A. Proudlock and Frank Renkewitz and Austin Roorda and Michael Schulte‐Mecklenbeck and Bonita Sharif and Frederick Shic and Mark Shovman and Mervyn G. Thomas and Ward Venrooij and Raimondas Zemblys and Roy S. Hessels},
  title = {{Retraction Note: Eye tracking: empirical foundations for a minimal reporting guideline}},
  booktitle = {Behavior},
  year = {2023},
  doi = {10.3758/s13428-023-02285-0},
}
Figure