The Benefits of an Augmented Reality Magic Mirror System for Integrated Radiology Teaching in Gross Anatomy

Felix Bork, Leonard Stratmann, Stefan Enssle, Ulrich Eck, Nassir Navab, Jens Waschke, Daniela KugelmannAnatomical 2019 · DOI

TL;DR

This paper investigates the effectiveness of an Augmented Reality (AR) "Magic Mirror" system for teaching gross anatomy and radiology, comparing it to a high-end virtual dissection table (Anatomage) and traditional radiology atlases. The AR system demonstrated comparable learning outcomes to established methods, particularly benefiting students with lower spatial reasoning skills.

What Problem Does This Paper Address?

Medical education is increasingly recognizing the importance of integrating radiology into anatomy courses to improve students' understanding of both disciplines. However, traditional teaching methods often struggle to bridge the gap between anatomical knowledge and the interpretation of medical images like CT and MRI scans. Existing novel technologies, such as virtual dissection tables, offer interactive learning but can be expensive and may not fully address the challenges of spatial understanding, especially for students with weaker spatial reasoning abilities. This paper aims to evaluate a novel AR "Magic Mirror" system as a potentially more accessible and effective tool for this integrated learning.

Methods

The study employed a mixed-methods approach involving two phases:

  1. Gross Anatomy Course (Study I): A large cohort of 749 first-year medical students used both the AR Magic Mirror and the Anatomage table in dedicated tutorial sessions. Feedback was collected via surveys to gauge subjective perceptions of usability and educational value.
  2. Elective Anatomy and Radiology Course (Study II): A smaller group of 72 students participated in a self-directed learning session using either the Magic Mirror, Anatomage, or traditional radiology atlases. A pre- and posttest design with multiple-choice questions was used to quantitatively measure learning outcomes. Additionally, a mental rotation test (MRT) was administered to assess spatial reasoning abilities, and participants were analyzed in subgroups based on their MRT scores.

The AR Magic Mirror system projects a user's reflection onto a large display, overlaying virtual anatomical models and corresponding medical image slices (CT, MRI). Users can interact with the system using hand gestures to change imaging modalities and slice planes. The Anatomage table offers a similar functionality with a life-sized, interactive 3D visualization of anatomy and cross-sectional images.

Datasets

The study did not introduce new benchmark datasets. Instead, it utilized:

  • Medical Image Volumes: CT and MRI volumes, as well as high-resolution photographic images of cryosections, were used.
  • Anatomical Atlases: Standard radiology atlases (e.g., Netter, Paulsen and Waschke) were used as a comparison group.

Key Insights and Ideas

  • AR for Spatial Understanding: The AR Magic Mirror system appears particularly beneficial for students with lower spatial reasoning skills, helping them improve their understanding of 3D anatomical relationships. This is likely due to the system's ability to present medical images in direct relation to the user's own body.
  • Bridging the Anatomy-Radiology Gap: The study strongly suggests that interactive 3D technologies like the Magic Mirror are crucial for creating a link between topographic anatomy and radiological slices, a connection that is often difficult for students to make with traditional methods.
  • Accessibility vs. Immersion: While the Anatomage table offers a highly immersive experience, the Magic Mirror's lower hardware requirements and potential for home use make it a more accessible supplementary learning tool.
  • Subjectivity in Learning Preferences: Student preferences for learning modalities are highly subjective, with some students finding the Magic Mirror more intuitive and others appreciating the Anatomage's large display for collaborative learning.

Key Results

Study I (Gross Anatomy Course - Survey Data): * Both the Magic Mirror and Anatomage were perceived as valuable enhancements for dissection courses, though not as replacements. * The Anatomage was rated as a superior tool for a "first contact" with anatomy. * The Magic Mirror was considered significantly more intuitive to use than the Anatomage.

Study II (Elective Course - Quantitative Data): * Overall Learning Improvement: All three groups (Magic Mirror, Anatomage, Theory) showed significant improvements in posttest scores compared to pretest scores. * Image vs. Text Questions: The learning gains were primarily driven by improved performance on image-based questions, indicating the value of visual learning tools for understanding anatomical structures in medical imaging. * Anatomage vs. Magic Mirror: While both systems showed comparable learning outcomes, the Anatomage group did not show a significant improvement from pre- to posttest in the overall score, whereas the Magic Mirror and Theory groups did. * MRT Impact: Students with low MRT scores showed significantly greater improvement in posttest scores when using the Magic Mirror or Anatomage compared to those using traditional atlases. This highlights the benefit of these 3D tools for students struggling with spatial reasoning.

Limitations and Future Work

  • Limited Interaction Time (Study I): In the initial gross anatomy course, students had limited interaction time with the systems, which may have influenced their initial perceptions.
  • No Pathology: The study did not include pathologies, which could be a valuable area for future research.
  • Cognitive Load: The cognitive load associated with using the AR systems was not explicitly studied, though participants did not report experiencing cognitive difficulties.
  • Single-Center Study: The results are from a single-center study, and future multi-center studies are needed to validate the findings.
  • Future Directions: The authors suggest further research into the Magic Mirror's impact on spatial ability acquisition and its potential for home use. Investigating the integration of pathologies and exploring the systems' use in dissection theaters are also recommended.

Summary updated

Abstract

Early exposure to radiological cross-section images during introductory anatomy and dissection courses increases students' understanding of both anatomy and radiology. Novel technologies such as augmented reality (AR) offer unique advantages for an interactive and hands-on integration with the student at the center of the learning experience. In this article, the benefits of a previously proposed AR Magic Mirror system are compared to the Anatomage, a virtual dissection table as a system for combined anatomy and radiology teaching during a two-semester gross anatomy course with 749 first-year medical students, as well as a follow-up elective course with 72 students. During the former, students worked with both systems in dedicated tutorial sessions which accompanied the anatomy lectures and provided survey-based feedback. In the elective course, participants were assigned to three groups and underwent a self-directed learning session using either Anatomage, Magic Mirror, or traditional radiology atlases. A pre- and posttest design with multiple choice questions revealed significant improvements in test scores between the two tests for both the Magic Mirror and the group using radiology atlases, while no significant differences in test scores were recorded for the Anatomage group. Furthermore, especially students with low mental rotation test (MRT) scores benefited from the Magic Mirror and Anatomage and achieved significantly higher posttest scores compared to students with a low MRT score in the theory group. Overall, the results provide supporting evidence that the Magic Mirror system achieves comparable results in terms of learning outcome to established anatomy learning tools such as Anatomage and radiology atlases.
BibTeX
@inproceedings{bork2019benefits,
  author = {Felix Bork and Leonard Stratmann and Stefan Enssle and Ulrich Eck and Nassir Navab and Jens Waschke and Daniela Kugelmann},
  title = {{The Benefits of an Augmented Reality Magic Mirror System for Integrated Radiology Teaching in Gross Anatomy}},
  booktitle = {Anatomical},
  year = {2019},
  doi = {10.1002/ase.1864},
}
Figure