What Is Medical Extended Reality? A Taxonomy Defining the Current Breadth and Depth of an Evolving Field

Brennan Spiegel, Albert Rizzo, Susan Persky, Omer Liran, Brenda K. Wiederhold, Susan Woods, Kate Donovan, Korak Sarkar, Henry Xiang, Sun Joo, Rohan Jotwani, Min Lang, Margot Paul, Mike Senter-Zapata, Keith Widmeier, Haipeng ZhangJournal of Medical Extended Reality 2024 · DOI

TL;DR

Medical Extended Reality (MXR) is a rapidly growing field, but it lacks a standardized way to categorize its vast array of research and applications. This paper introduces a comprehensive taxonomy developed by a global panel of experts, aiming to bring clarity and structure to MXR by defining 13 primary topics and 180 secondary topics across five core domains. This taxonomy will serve as a foundational tool for researchers, clinicians, and regulators, fostering better communication and guiding future development.

What Problem Does This Paper Address?

The field of Medical Extended Reality (MXR) – encompassing virtual, augmented, and mixed reality in healthcare – has exploded in recent years. Despite its rapid growth and increasing recognition by bodies like the FDA, there's a significant lack of a unified system for classifying the diverse research, technologies, and applications within MXR. This absence of a standardized taxonomy makes it challenging for researchers, clinicians, funders, and policymakers to navigate the field, communicate effectively, and understand its full scope. The paper aims to fill this gap by providing a structured framework to organize and categorize the multifaceted nature of MXR.

Methods

The authors, affiliated with the American Medical Extended Reality Association (AMXRA) and the Journal of Medical Extended Reality, convened a multidisciplinary and international panel of experts. These experts were selected based on their publication records, contributions to MXR, and other objective measures. The taxonomy was developed through an iterative process:

  1. Initial Topic Identification: Each panel member independently identified core MXR topics from their unique perspective.
  2. Review and Consolidation: The compiled list was reviewed by the entire group. New topics were added, similar ones were consolidated, and disparate ones were separated.
  3. Public Feedback: The draft taxonomy was shared online (via X, formerly Twitter) to solicit broader community feedback.
  4. Refinement: A final round focused on fine-tuning topic names and ensuring accurate categorization of secondary topics.

This rigorous, collaborative approach aimed to capture the current breadth and depth of MXR.

Datasets

Not discussed in the paper. The paper focuses on developing a conceptual framework rather than empirical analysis of datasets.

Key Insights and Ideas

  • The Need for Structure: The sheer volume and diversity of MXR applications highlight the critical need for a standardized taxonomy to prevent fragmentation and foster cohesive understanding.
  • Multifaceted Nature of MXR: The taxonomy reveals that MXR is not just about the technology itself but also its integration, design, clinical impact, educational value, and ethical considerations.
  • A "Living Document": The authors acknowledge that MXR is a dynamic field and present the taxonomy as a "living document" that will require updates and revisions as the field evolves.
  • Emergent Narrative: The taxonomy is visualized as a cyclical process, illustrating a narrative flow from technological innovation through design, application, education, and governance, emphasizing the interconnectedness of these domains.

Key Results

The primary outcome of this paper is the development of a comprehensive taxonomy for Medical Extended Reality. This taxonomy includes:

  • Five Overarching Domains:
    1. Technological integration and innovation
    2. Design, development, and deployment
    3. Clinical and therapeutic applications
    4. Education, training, and communication
    5. Ethical, regulatory, and socioeconomic considerations
  • 13 Primary Topics: These branch out from the five core domains.
  • 180 Secondary Topics: These provide granular detail within the primary topics, demonstrating the extensive scope of MXR.

The paper provides a narrative description of each of the 13 primary topics, offering insights into their significance and scope within the MXR landscape.

Limitations and Future Work

  • Not Static: The authors explicitly state that the taxonomy is a snapshot and will need updates as MXR continues to evolve.
  • Potential for Unrepresented Topics: While extensive, the authors acknowledge that emerging or unrepresented topics might not be included in the current schema.
  • Future Work: The taxonomy is intended to be a foundational tool. Its practical application will be seen in its use for classifying research submissions (e.g., to the Journal of Medical Extended Reality), guiding regulators, and assisting funders. The authors anticipate that the taxonomy will be instrumental in guiding the field's development and ensuring a cohesive understanding.

Summary updated

Abstract

Medical extended reality (MXR) has emerged as a dynamic field at the intersection of health care and immersive technology, encompassing virtual, augmented, and mixed reality applications across a wide range of medical disciplines. Despite its rapid growth and recognition by regulatory bodies, the field lacks a standardized taxonomy to categorize its diverse research and applications. This American Medical Extended Reality Association guideline, authored by the editorial board of the <i>Journal of Medical Extended Reality</i>, introduces a comprehensive taxonomy for MXR, developed through a multidisciplinary and international collaboration of experts. The guideline seeks to standardize terminology, categorize existing work, and provide a structured framework for future research and development in MXR. An international and multidisciplinary panel of experts was convened, selected based on publication track record, contributions to MXR, and other objective measures. Through an iterative process, the panel identified primary and secondary topics in MXR. These topics were refined over several rounds of review, leading to the final taxonomy. The taxonomy comprises 13 primary topics that jointly expand into 180 secondary topics, demonstrating the field's breadth and depth. At the core of the taxonomy are five overarching domains: (1) technological integration and innovation; (2) design, development, and deployment; (3) clinical and therapeutic applications; (4) education, training, and communication; and (5) ethical, regulatory, and socioeconomic considerations. The developed taxonomy offers a framework for categorizing the diverse research and applications within MXR. It may serve as a foundational tool for researchers, clinicians, funders, academic publishers, and regulators, facilitating clearer communication and categorization in this rapidly evolving field. As MXR continues to grow, this taxonomy will be instrumental in guiding its development and ensuring a cohesive understanding of its multifaceted nature.
BibTeX
@article{spiegel2024what,
  author = {Brennan Spiegel and Albert Rizzo and Susan Persky and Omer Liran and Brenda K. Wiederhold and Susan Woods and Kate Donovan and Korak Sarkar and Henry Xiang and Sun Joo and Rohan Jotwani and Min Lang and Margot Paul and Mike Senter-Zapata and Keith Widmeier and Haipeng Zhang},
  title = {{What Is Medical Extended Reality? A Taxonomy Defining the Current Breadth and Depth of an Evolving Field}},
  journal = {Journal of Medical Extended Reality},
  year = {2024},
  doi = {10.1089/jmxr.2023.0012},
}
Figure