The APOSTEL recommendations for reporting quantitative optical coherence tomography studies

Andrés Cruz-Herranz, Lisanne J. Balk, Timm Oberwahrenbrock, Shiv Saidha, Elena H. Martínez‐Lapiscina, Wolf A. Lagrèze, Joel S. Schuman, Pablo Villoslada, Peter A. Calabresi, Laura J. Balcer, Axel Petzold, Ari Green, Friedemann Paul, Alexander U. Brandt, Philipp Albrecht, Jaime Imitola, Ahmed Toosy, Hanna Zimmermann, Olivier Outteryck, Rachel Nolan, Scott Kolbe, Jette Lautrup Frederiksen Battistini, Orhan Aktaş, Letizia Leocani, Ann Ming Yeh, Joachim Havla, Marius Ringelstein, Gorm Pihl-Jensen, Jana Lízrová Preiningerová, Sven Schippling, Fiona CostelloNeurology 2016 · DOI

TL;DR

This paper addresses the growing need for standardized reporting in quantitative optical coherence tomography (OCT) studies, particularly in neurology. The authors propose a 9-point checklist, the APOSTEL recommendations, to improve the consistency, comparability, and overall quality of OCT research, making findings more reliable and applicable across different studies and clinical settings.

What Problem Does This Paper Address?

Optical coherence tomography (OCT) has become an invaluable tool for visualizing and quantifying microstructural changes in the retina, offering insights into various neurological and ophthalmological conditions. As OCT technology advances and its application expands to a wider range of diseases, including multiple sclerosis and other neurodegenerative disorders, the number of quantitative OCT studies has surged. However, this rapid growth has outpaced the development of standardized reporting practices. This lack of consistency leads to difficulties in critically assessing study strengths and weaknesses, comparing results across different research groups, and generalizing findings. Ambiguous reporting of methodological details, such as scan protocols, quality control, and data analysis, creates uncertainty and hinders the advancement of OCT research and its clinical application.

Methods

The APOSTEL recommendations were developed through an expert consensus process involving experienced OCT researchers from neurology and ophthalmology. The process began with experienced researchers discussing essential requirements for performing and reporting quantitative OCT analyses. This led to an initial list of recommendations, which was then refined through several meetings of a coordinating group. The final recommendations are presented as a 9-point checklist designed to cover key aspects of quantitative OCT study reporting. The authors emphasize that these recommendations are intended to complement existing reporting guidelines (e.g., STROBE, CONSORT) by adding specific parameters relevant to OCT.

Datasets

Not discussed in the paper. The paper focuses on methodology and reporting standards rather than presenting results from specific datasets.

Key Insights and Ideas

  • The Need for Standardization is Urgent: With the proliferation of OCT studies, a common language and reporting framework are crucial for scientific rigor and clinical translation.
  • Beyond General Guidelines: While existing reporting guidelines are valuable, OCT studies require specific parameters due to the unique nature of the technology and its data.
  • A Holistic Approach: The APOSTEL recommendations cover the entire research pipeline, from study protocol and acquisition to post-acquisition analysis and statistical reporting.
  • Focus on Reproducibility and Comparability: Each recommendation aims to provide enough detail for other researchers to understand, replicate, and compare findings.
  • Expert Consensus as a Starting Point: While not based on a systematic review, the recommendations represent the collective expertise of experienced researchers, providing a practical and actionable framework.

Key Results

The paper's primary "result" is the development and presentation of the APOSTEL recommendations, a 9-point checklist for reporting quantitative OCT studies. This checklist includes detailed items for:

  1. Study protocol: Including number of sites, graders, and timing of OCT relative to other measurements.
  2. Acquisition device: Manufacturer, model, version, and software version.
  3. Acquisition settings: Room light conditions, pupil dilation, and number of operators/devices.
  4. Scanning protocol: Type of scan, location of interest, scan parameters (including eye tracking), and details for volume, radial, and line scans.
  5. Funduscopic imaging: Reporting of additional imaging modalities and their protocols.
  6. Postacquisition data selection: Image selection process, quality control criteria, and postacquisition discards.
  7. Postacquisition analysis: Software used, segmentation methods, and how bias was addressed.
  8. Nomenclature and abbreviations: Defining anatomical structures and units of measurement.
  9. Statistical approach: Describing models used and how intereye dependencies were handled.

The authors also provide a proposed consensus nomenclature for retinal structures and layers in Table 2 and a visual representation in Figure 1.

Limitations and Future Work

The authors acknowledge several limitations:

  • Level of Evidence: The recommendations are based on expert consensus (Class IV evidence) rather than a systematic review of the literature. Formal experimental evidence for the influence of many recommended parameters on OCT results is often lacking.
  • Consortium Dominance: The recommendations were primarily developed by a consortium dominated by neurologists, with a focus on quantitative detection and analysis of retinal changes. While efforts were made to be broadly applicable, further development is needed for wider application.
  • MS Focus: The IMSVISUAL consortium, which contributed to the recommendations, is predominantly focused on MS research.

Future work will involve refining, evaluating, and validating these recommendations through a more formal approach with a larger forum of researchers to develop more evidence-based guidelines. The authors welcome suggestions for improvement and invite readers to submit comments via the IMSVISUAL website, where updated recommendations and checklists will be available.

Summary updated

Abstract

The Advised Protocol for OCT Study Terminology and Elements recommendations include core items to standardize and improve quality of reporting in quantitative OCT studies. The recommendations will make reporting of quantitative OCT studies more consistent and in line with existing standards for reporting research in other biomedical areas. The recommendations originated from expert consensus and thus represent Class IV evidence. They will need to be regularly adjusted according to new insights and practices.
BibTeX
@inproceedings{cruzherranz2016apostel,
  author = {Andrés Cruz-Herranz and Lisanne J. Balk and Timm Oberwahrenbrock and Shiv Saidha and Elena H. Martínez‐Lapiscina and Wolf A. Lagrèze and Joel S. Schuman and Pablo Villoslada and Peter A. Calabresi and Laura J. Balcer and Axel Petzold and Ari Green and Friedemann Paul and Alexander U. Brandt and Philipp Albrecht and Jaime Imitola and Ahmed Toosy and Hanna Zimmermann and Olivier Outteryck and Rachel Nolan and Scott Kolbe and Jette Lautrup Frederiksen Battistini and Orhan Aktaş and Letizia Leocani and Ann Ming Yeh and Joachim Havla and Marius Ringelstein and Gorm Pihl-Jensen and Jana Lízrová Preiningerová and Sven Schippling and Fiona Costello},
  title = {{The APOSTEL recommendations for reporting quantitative optical coherence tomography studies}},
  booktitle = {Neurology},
  year = {2016},
  doi = {10.1212/wnl.0000000000002774},
}
Figure