Transparency and reproducibility in artificial intelligence

Benjamin Haibe-Kains, George Alexandru Adam, Ahmed Hosny, Farnoosh Khodakarami, Thakkar Shraddha, Rebecca Kusko, Susanna‐Assunta Sansone, Weida Tong, Russ Wolfinger, Christopher E. Mason, Wendell Jones, Joaquı́n Dopazo, Cesare Furlanello, Levi Waldron, Bo Wang, Chris McIntosh, Anna Goldenberg, Anshul Kundaje, Casey S. Greene, Tamara Broderick, Michael M. Hoffman, Jeffrey T. Leek, Keegan Korthauer, Wolfgang Huber, Alvis Brāzma, Joëlle Pineau, Robert Tibshirani, Trevor Hastie, John P. A. Ioannidis, John Quackenbush, Hugo J. W. L. AertsNature 2020 · DOI · OpenAlex

Abstract

Breakthroughs in artificial intelligence (AI) hold enormous potential as it can automate complex tasks and go even beyond human performance. In their study, McKinney et al. showed the high potential of AI for breast cancer screening. However, the lack of methods’ details and algorithm code undermines its scientific value. Here, we identify obstacles hindering transparent and reproducible AI research as faced by McKinney et al., and provide solutions to these obstacles with implications for the broader field.
BibTeX
@inproceedings{haibekains2020transparency,
  author = {Benjamin Haibe-Kains and George Alexandru Adam and Ahmed Hosny and Farnoosh Khodakarami and Thakkar Shraddha and Rebecca Kusko and Susanna‐Assunta Sansone and Weida Tong and Russ Wolfinger and Christopher E. Mason and Wendell Jones and Joaquı́n Dopazo and Cesare Furlanello and Levi Waldron and BO WANG and Chris McIntosh and Anna Goldenberg and Anshul Kundaje and Casey S. Greene and Tamara Broderick and Michael M. Hoffman and Jeffrey T. Leek and Keegan Korthauer and Wolfgang Huber and Alvis Brāzma and Joëlle Pineau and Robert Tibshirani and Trevor Hastie and John P. A. Ioannidis and John Quackenbush and Hugo J. W. L. Aerts and Hugo J. W. L. Aerts},
  title = {{Transparency and reproducibility in artificial intelligence}},
  booktitle = {Nature},
  year = {2020},
  doi = {10.1038/s41586-020-2766-y},
}

Loading related content...

Figure