Benchmarking Wilms’ tumor in multisequence MRI data: why does current clinical practice fail? Which popular segmentation algorithms perform well?

Sabine Müller, Iva Farag, Joachim Weickert, Yvonne Braun, André Lollert, Jonas Dobberstein, Andreas M. Hötker, Norbert GrafJournal of Medical Imaging 2019 · DOI

Abstract

Wilms' tumor is one of the most frequent malignant solid tumors in childhood. Accurate segmentation of tumor tissue is a key step during therapy and treatment planning. Since it is difficult to obtain a comprehensive set of tumor data of children, there is no benchmark so far allowing evaluation of the quality of human or computer-based segmentations. The contributions in our paper are threefold: (i) we present the first heterogeneous Wilms' tumor benchmark data set. It contains multisequence MRI data sets before and after chemotherapy, along with ground truth annotation, approximated based on the consensus of five human experts. (ii) We analyze human expert annotations and interrater variability, finding that the current clinical practice of determining tumor volume is inaccurate and that manual annotations after chemotherapy may differ substantially. (iii) We evaluate six computer-based segmentation methods, ranging from classical approaches to recent deep-learning techniques. We show that the best ones offer a quality comparable to human expert annotations.
BibTeX
@article{muller2019benchmarking,
  author = {Sabine Müller and Iva Farag and Joachim Weickert and Yvonne Braun and André Lollert and Jonas Dobberstein and Andreas M. Hötker and Norbert Graf},
  title = {{Benchmarking Wilms’ tumor in multisequence MRI data: why does current clinical practice fail? Which popular segmentation algorithms perform well?}},
  journal = {Journal of Medical Imaging},
  year = {2019},
  doi = {10.1117/1.jmi.6.3.034001},
}

Loading related content...

Figure