Reproducibility Made Easy: A Tool for Methodological Transparency and Efficient Standardized Reporting Based on the Proposed MRSinMRS Consensus

Antonia Šušnjar, Antonia Kaiser, Dunja Simičić, Gianna Nossa, Alexander Lin, Georg Oeltzschner, Aaron T. GudmundsonNMR 2025 · DOI

TL;DR

Reproducibility in Magnetic Resonance Spectroscopy (MRS) is hampered by inconsistent reporting of experimental parameters. This paper introduces REMY, a user-friendly software tool that automatically extracts and formats essential MRS hardware and acquisition data into a standardized reporting table, significantly easing the burden on researchers and promoting better scientific reproducibility.

What Problem Does This Paper Address?

Magnetic Resonance Spectroscopy (MRS) is a powerful technique for non-invasively probing the metabolic landscape of tissues. However, its clinical translation has been slow, partly due to a lack of reproducibility in research studies. This stems from the "methodological heterogeneity" in the field, meaning that different labs and even different studies within the same lab can use vastly different acquisition parameters and analysis pipelines without clear documentation. To address this, the MRSinMRS consensus guidelines were developed, providing a checklist for minimum reporting standards. Despite these guidelines, their adoption has been slow. The primary hurdles are the diverse data formats and naming conventions used by different scanner vendors, making it a tedious and error-prone manual process for researchers to extract and report all the necessary information. This paper tackles the challenge of making MRSinMRS compliance accessible and efficient for all MRS researchers.

Methods

The core of this work is the development of the REproducibility Made EasY (REMY) software. REMY is a standalone, open-source application designed to automate the population of the MRSinMRS table. It achieves this by:

  • Broad Data Format Support: REMY can ingest data from major MRS vendors, including GE (.7), Siemens (.ima, .rda, .dat), Philips (.spar/.sdat), and Bruker (.method), as well as the NIfTI format (.nii/.json).
  • Leveraging External Libraries: It utilizes spec2nii and pymapVBVD to parse the complex header information within these diverse file formats.
  • Parameter Extraction and Translation: REMY identifies and translates vendor-specific parameter names into the standardized MRSinMRS nomenclature.
  • Automated Table and Methods Generation: Once data is imported, REMY automatically populates the "Hardware" and "Acquisition" sections of the MRSinMRS table. Crucially, it also generates a boilerplate methods section for manuscripts, directly incorporating the extracted parameters.
  • User-Friendly Interface: The application features an intuitive graphical user interface (GUI) that requires no programming knowledge, making it accessible to a wide range of users.

Datasets

The development of REMY utilized an initial set of single-voxel spectroscopy (SVS) datasets comprising:

  • 15 Siemens datasets (8 Twix, 3 DICOM, 2 RDA)
  • 8 Philips .spar/.sdat datasets
  • 8 GE pfiles (.7)
  • 2 Bruker method files

This initial dataset covered various field strengths (3T, 7T, 14T) and pulse sequences (STEAM, LASER, SLASER, PRESS, MEGA-PRESS, HERMES).

For crash testing and validation, REMY was further tested on publicly available data from the Big GABA dataset, including 45 PRESS datasets from 3 sites per vendor (GE, Siemens Twix, Philips). Additional test data was also employed, including GE, Philips, Siemens Twix, Siemens DICOM, RDA, and Bruker datasets.

Key Insights and Ideas

  • The "Human Error" Bottleneck: The sheer diversity in MRS data formats and parameter naming conventions is a significant barrier to consistent reporting. Manual extraction is not only time-consuming but also highly prone to errors, undermining reproducibility.
  • Bridging the Gap: REMY acts as a crucial bridge, translating the complex, vendor-specific information embedded in MRS data headers into a standardized, human-readable format. This significantly lowers the barrier to entry for adhering to reporting guidelines.
  • Beyond the Table: Generating a methods section automatically is a significant value-add. This not only saves researchers time but also ensures that the reporting aligns with the data extracted for the MRSinMRS table, promoting internal consistency.
  • Open Source for Community Growth: The open-source nature of REMY is key. It allows for community contributions, integration with other MRS processing tools, and future expansion to cover more complex MRS techniques (e.g., multi-voxel MRS).

Key Results

REMY demonstrated high success rates in extracting key hardware and acquisition parameters:

  • Hardware: Successfully populated fields for Field Strength, Manufacturer, and Software Version for all tested file types.
  • Acquisition: Accurately extracted Pulse Sequence Name, Nominal VOI Size, TR, TE, Total Number of Acquisitions (NA), Spectral Width, and Number of Spectral Points from most file types.
  • Overall: Achieved 100% success rates in importing and extracting targeted parameters for Philips .spar/.sdat, Siemens Twix (.dat), Siemens DICOM (.ima), and Siemens RDA (.rda) datasets. GE pfiles (.7) also showed 100% success, with a minor exception for spectral points in older versions. Bruker method files and MRS-NIfTI files were also successfully processed.

Limitations and Future Work

  • Incomplete Parameter Population: REMY could not populate data for RF coils and additional hardware information, as this data was often absent in the header files. Similarly, information like VOI anatomical location, water suppression method, and shimming method were not always available and require manual input.
  • Single Voxel Focus: Currently, REMY is primarily designed for single-voxel spectroscopy (SVS) studies, limiting its direct applicability to multi-voxel MRS (MRSI) studies.
  • User Input for Modified Sequences: While REMY reads pulse sequence names, user-modified or renamed sequences may require manual correction by the user.

Future work suggested by the authors includes:

  • Integration with Analysis Pipelines: Integrating REMY with existing MRS processing pipelines (like Osprey) to automate the population of data analysis and quality sections of the MRSinMRS table.
  • Expanding to MRSI: Extending REMY's capabilities to support multi-voxel MRS (MRSI) studies.
  • Demographics Section: Adding a demographics section to the output, which would be particularly useful for meta-analyses.
  • Highlighting Divergences: Identifying and highlighting parameters that diverge across datasets within a single study.
  • Editable Parameter Lists: Providing users with an editable list of extracted parameters to insert missing information (e.g., water suppression method) before generating the final methods section.

Summary updated

Abstract

Recent expert consensus publications have highlighted the issue of poor reproducibility in magnetic resonance spectroscopy (MRS) studies, mainly due to the lack of standardized reporting criteria, which affects their clinical applicability. To combat this, guidelines for minimum reporting standards (MRSinMRS) were introduced to aid journal editors and reviewers in ensuring the comprehensive documentation of essential MRS study parameters. Despite these efforts, the implementation of MRSinMRS standards has been slow, attributed to the diverse nomenclature used by different vendors, the variety of raw MRS data formats, and the absence of appropriate software tools for identifying and reporting necessary parameters. To overcome this obstacle, we have developed the REproducibility Made Easy (REMY) standalone toolbox. REMY software supports a range of MRS data formats from major vendors like GE (.7), Siemens (.ima, .rda, .dcm), Philips (.spar/.sdat), and Bruker (.method), and MRS-NIfTI (.nii/nii.gz/.json) files facilitating easy data import and export through a user-friendly interface. REMY employs external libraries such as spec2nii and pymapVBVD to accurately read and process these diverse data formats, translating complex header information into a comprehensive structure that adheres to consensus reporting standards, thereby ensuring compatibility and ease of use for researchers in generating reproducible MRS research outputs. Users can select and import datasets, choose the appropriate vendor and data format, and then generate an MRSinMRS table, log file, and methodological documents in both Latex and PDF formats by just clicking one button. No coding knowledge is required, making the tool accessible to a wider range of users, including researchers and clinicians without programming expertise. This eliminates technical challenges related to data formatting and reporting. REMY effectively populated key sections of the MRSinMRS table with data from all supported file types. Accurate generation of hardware parameters including field strength, manufacturer, and scanner software version were demonstrated. However, it could not input data for RF coil and additional hardware information due to their absence in the files. For the acquisition section, REMY accurately read and populated fields for the pulse sequence name, nominal voxel size, repetition time (TR), echo time (TE), number of acquisitions/excitations/shots, spectral width (Hz), and number of spectral points, significantly contributing to the completion of the "Acquisition" fields of the table. Furthermore, REMY generates a boilerplate methods text section for manuscripts. The use of REMY will facilitate more widespread adoption of the MRSinMRS checklist within the MRS community, making it easier to write and report acquisition parameters effectively.
BibTeX
@inproceedings{susnjar2025reproducibility,
  author = {Antonia Šušnjar and Antonia Kaiser and Dunja Simičić and Gianna Nossa and Alexander Lin and Georg Oeltzschner and Aaron T. Gudmundson},
  title = {{Reproducibility Made Easy: A Tool for Methodological Transparency and Efficient Standardized Reporting Based on the Proposed MRSinMRS Consensus}},
  booktitle = {NMR},
  year = {2025},
  doi = {10.1002/nbm.70039},
}
Figure