Author Correction: Ensembles of data-efficient vision transformers as a new paradigm for automated classification in ecology

Sreenath P. Kyathanahally, Thomas Hardeman, Marta Reyes, Ewa Merz, Thea Bulas, Philipp Brun, Francesco Pomati, Marco Baity‐JesiScientific 2023 · DOI · OpenAlex

This article summarizes a significant correction to the study "Ensembles of data-efficient vision transformers as a new paradigm for automated classification in ecology," originally published in Scientific Reports. While an evaluation bug led to the overestimation of performance for certain models, the core finding—that ensembles of data-efficient transformers (EDeiTs) offer a robust, "plug-and-play" alternative for ecological classification—remains valid.

The Evaluation Bug and Its Impact

Following the publication of the original study, the authors identified a critical bug in the evaluation script for the Ensembles of Data-efficient image Transformers (EDeiTs). During testing, different models within the same ensemble were inadvertently shown different images from the same class. This artificial diversity led to inflated accuracy scores because the ensemble was not being tested on a consistent set of inputs across its constituent models.

Importantly, this bug was isolated to the EDeiT evaluation script; all other single models and standard ensembles remained unaffected. The correction has led to revised results in the Abstract, Results, and Discussion sections, as well as updates to the primary figures and tables.

Revised Performance Metrics

In the original report, EDeiTs appeared to drastically outperform the state-of-the-art (SOTA) across nearly all tested datasets. The corrected analysis provides a more tempered but still impressive outlook. EDeiTs matched or exceeded SOTA performance in 4 out of the 10 ecological datasets tested.

Original Figure 1: The initial evaluation (containing the bug) suggested that EDeiTs significantly outperformed SOTA across all ten ecological datasets.

Key performance corrections include:

  • ZooLake Dataset: The F1-score was revised from a near-perfect 0.983 down to 0.924.
  • General SOTA Comparison: While no longer a universal "SOTA-killer," EDeiTs remain highly competitive, achieving comparable results in the remaining 6 datasets without the need for the intensive hyperparameter tuning typically required by Convolutional Neural Networks (CNNs).

Why the Paradigm Still Holds: Model Diversity

The central thesis of the paper—that EDeiTs represent a new paradigm for ecologists—relies on the inherent diversity of Transformer-based models. Ensembling is most effective when the individual learners make different types of mistakes.

Original Figure 2: Analysis of model agreement (R=Right, W=Wrong) across ensemble members for CNNs and DeiTs.

The corrected similarity metric ($S$) for DeiT models is 0.799, which is significantly lower than the 0.945 observed in CNNs. This confirms that DeiT models are naturally more diverse in their predictions. As shown in the agreement analysis (Figure 2), DeiTs exhibit higher counts of "disagreement" (e.g., the R,R,W category), allowing the ensemble to "outvote" individual errors more effectively than more homogeneous CNN ensembles.

Conclusion

The corrected findings clarify that EDeiTs are not a "magic bullet" for every dataset. However, they remain a powerful tool for researchers who are not machine learning experts. By providing SOTA-level performance with a fixed training schedule and no dataset-specific tuning, EDeiTs offer a robust, accessible alternative for automated species identification in complex ecological imaging tasks.

Summary updated

Abstract

The original version of this Article contained errors, where the Ensembles of Data-efficient image Transformers (EDeiTs) had a lower performance than stated.After publication, the authors noticed a bug in the evaluation of the EDeiT models, where different models in the same ensemble were seeing different images, (always from the same class), which artificially increased the test performance.This bug was only present in the script for EDeiTs, all other models (single models and ensembles), were unaffected.The main conclusion of the paper, that one can use EDeiTs to obtain well-performing models avoiding parameter tuning, is still valid, since the performances are always similar to the previous state-of-the-art (SOTA).Errors have been corrected in the Abstract, the Results, the Discussion, Figure 1 and its caption, Figure 2, Table 1, and the Supplementary Information file.The original Figures 1 and2, and the original Supplementary Information file are provided below.In the Results, the subheading ' Arithmetic versus geometric averaging for ensembling' and Table 2 have been removed.Consequently, the following references have been removed from the reference list and subsequent references have been renumbered in the text.
BibTeX
@inproceedings{kyathanahally2023author,
  author = {Sreenath P. Kyathanahally and Thomas Hardeman and Marta Reyes and Ewa Merz and Thea Bulas and Philipp Brun and Francesco Pomati and Marco Baity‐Jesi},
  title = {{Author Correction: Ensembles of data-efficient vision transformers as a new paradigm for automated classification in ecology}},
  booktitle = {Scientific},
  year = {2023},
  doi = {10.1038/s41598-023-32258-4},
}
Figure