TL;DR
This paper introduces the Image Biomarker Standardization Initiative (IBSI), a crucial effort to standardize radiomics features. By developing a comprehensive set of definitions, reference values, and reporting guidelines, IBSI aims to overcome the reproducibility crisis in radiomics, paving the way for more reliable and clinically applicable quantitative imaging biomarkers.
What Problem Does This Paper Address?
The paper tackles a significant challenge in the field of radiomics: the lack of standardization. While radiomics holds immense promise for extracting quantitative biomarkers from medical images to characterize tumors and predict treatment outcomes, the absence of universally agreed-upon definitions, calculation methods, and reference values has led to a "wild frontier" of irreproducible results. This inconsistency hinders the clinical translation of radiomics findings, making it difficult to compare studies or trust the reliability of extracted features. IBSI aims to bridge this gap by providing a standardized framework for radiomic feature extraction and reporting.
Methods
The IBSI initiative employed a multi-phase approach to standardize a set of radiomic features.
- Phase I: Focused on standardizing 174 basic radiomic features. 25 research teams independently computed these features from a digital phantom, using their own radiomics software implementations. This phase aimed to establish initial reference values and assess the reproducibility of features without complex image processing.
- Phase II: Expanded to include 1347 derived features, computed from a lung cancer CT image using predefined image processing configurations. 15 teams participated in this phase, further refining reference values and evaluating features under more realistic clinical imaging conditions.
- Phase III: A prospective validation phase using a public dataset of multimodality images (CT, PET, MRI) from 51 patients with soft-tissue sarcoma. This phase aimed to assess the reproducibility of the standardized features across different imaging modalities and software implementations.
Consensus on reference values was measured by the frequency of the modal value and classified as weak, moderate, strong, or very strong.
Datasets
The IBSI initiative utilized the following datasets:
- Digital Phantom: A small, custom-developed digital phantom was used in Phase I. This phantom was designed to be simple, consisting of 5x4x4 voxels with specific grey level intensities and excluded voxels. It served as a baseline for feature extraction without complex image processing.
- Lung Cancer CT Image: A CT image from one patient with lung cancer (PAT1) was used in Phase II. This dataset, available through cancerdata.org (DOI:10.17195/candat.2016.08.1), was used with predefined image processing configurations.
- Multimodality Image Dataset: A public dataset of CT, 18F-FDG PET, and T1-weighted MRI images from 51 patients with soft-tissue sarcoma was used in Phase III for prospective validation. This dataset is available via the IBSI GitHub repository.
Key Insights and Ideas
- Reproducibility Crisis in Radiomics: The paper highlights that the lack of standardization is a major bottleneck for the clinical adoption of radiomics.
- Importance of Standardized Definitions: IBSI's core contribution is providing standardized definitions and reference values for a large set of radiomic features, enabling consistent interpretation across different studies and software.
- Multi-Phase Validation: The rigorous multi-phase approach, involving a digital phantom, a clinical CT image, and a multimodality dataset, ensures robust standardization and validation of the features.
- Impact of Image Processing: The study implicitly emphasizes the significant impact of image processing steps (interpolation, discretization, etc.) on feature values and the need for standardized protocols.
- Nomenclature System: The development of a clear nomenclature system is crucial for unambiguously referring to specific features and their associated parameters.
Key Results
- High Consensus Achieved: After the standardization process, IBSI achieved strong or very strong consensus on reference values for a vast majority of features (95.1% in Phase I and 90.6% in Phase II).
- Standardized Feature Set: A set of 169 radiomics features were successfully standardized.
- Excellent Reproducibility: In the final validation phase, these standardized features demonstrated excellent reproducibility across different imaging modalities (CT, PET, MRI) and software implementations.
- Reduced Ambiguity: The proposed nomenclature system effectively addresses the ambiguity arising from different software implementations and feature extraction settings.
Limitations and Future Work
- Feature Exclusions: While a large number of features were standardized, some features (two in Phase I and 19 in Phase II) still had weak consensus and were not standardized.
- Ongoing Development: The paper mentions that the IBSI is an ongoing initiative, with potential for future expansion of the feature set and refinement of guidelines.
- Clinical Validation: While the study focuses on standardization, the ultimate clinical utility and prognostic power of these standardized features require further extensive clinical validation.
- Software Compliance: The paper introduces the concept of IBSI compliance for radiomics software, suggesting that future work will involve verifying and certifying software implementations against the standardized features.
Summary updated