Keeper: Automated Testing and Fixing of Machine Learning Software—RCR Report

Chengcheng Wan, Shicheng Liu, Sophie Xie, Yuhan Liu, Michael Maire, Henry Hoffmann, Shan Lu

Abstract

This artifact aims to provide source code, benchmark suite, results, and materials used in our study “Keeper: Automated Testing and Fixing of Machine Learning Software” [ 3 ]. We developed an automated testing and fixing tool Keeper and its IDE plugin for ML software. It automatically detects software defects and attempts to change how ML APIs are used to alleviate software misbehavior. This artifact provides guidelines to set up and execute Keeper and also guidelines to interpret our evaluation results. We hope this artifact can motivate and help future research to further tackle ML API misuses. All related data are available online.
BibTeX
@article{wan2026keeper,
  author = {Chengcheng Wan and Shicheng Liu and Sophie Xie and Yuhan Liu and Michael Maire and Henry Hoffmann and Shan Lu},
  title = {{Keeper: Automated Testing and Fixing of Machine Learning Software—RCR Report}},
  journal = {ACM Trans. Softw. Eng. Methodol.},
  year = {2026},
  doi = {10.1145/3737284},
}

Loading related content...

Figure