Testing Adequacy of Convolutional Neural Network Based on Mutation Testing

Yi Yao, Jiuluo Liu, Song Huang, Zhanwei Hui, Kaishun Wu, Lele Chen, Sen Yang, Qiang ChenQRS Companion 2019 · OpenReview

Abstract

It is difficult to apply traditional testing adequacy criteria when measuring the adequacy of convolutional neural network applications. However, only a small number of test cases applied to the CNN model can achieve neuron coverage of almost 100%, overturning the effectiveness of the neuronal coverage criteria. In this paper, we propose a model coverage criterion based on mutation testing for CNN, and applying model coverage criterion to a common CNN image classification models (LeNet-5). we focus on the testing accuracy of model. Experiments show that our method can find the local optimal model and play an important role in improving the testing adequacy of the set of models.
BibTeX
@inproceedings{yao2019testing,
  author = {Yi Yao and Jiuluo Liu and Song Huang and Zhanwei Hui and Kaishun Wu and Lele Chen and Sen Yang and Qiang Chen},
  title = {{Testing Adequacy of Convolutional Neural Network Based on Mutation Testing}},
  booktitle = {QRS Companion},
  year = {2019},
  url = {https://openreview.net/forum?id=x0LzwvKybYh},
}

Loading related content...

Figure