Evaluating communication and clinical skills in objective structured clinical examination (OSCE) using a low-cost neck-mounted device, insights from a first-person perspective

Yu‐Ching Liu, I-Ching Liao, Ching‐Yi Wu, Chung‐Han Ho, Charles Lu, K. E. P. I. N. G. Chen, Chiehfeng ChenJournal of Dental Sciences 2025 · DOI

TL;DR

This study explores the use of low-cost, neck-mounted smartphones to capture first-person perspective (FPP) videos during dental Objective Structured Clinical Examinations (OSCEs). The findings suggest that this approach is a valuable and cost-effective tool for evaluating and improving dental interns' communication and clinical skills, with positive feedback from students regarding its educational utility.

What Problem Does This Paper Address?

Traditional methods for assessing clinical skills in medical education, particularly during Objective Structured Clinical Examinations (OSCEs), often rely on third-person perspective video recordings. While these can capture performance, they frequently suffer from limited audio and visual coverage, making it difficult to fully assess crucial elements like facial expressions and body language. This hinders detailed feedback and self-reflection, which are vital for developing communication skills, empathy, and overall clinical competence. Existing wearable devices like Google Glass have offered FPP capabilities but are often prohibitively expensive and have accessibility issues, especially in resource-limited settings. The paper addresses the need for a more accessible, cost-effective, and high-quality FPP recording solution for OSCEs that can enhance the learning experience for dental interns.

Methods

The study employed a novel approach using standardized patients (SPs) equipped with neck-mounted mobile phones running ApowerMirror Screen Recorder software. This setup allowed the SPs to synchronize their phone screens with a computer, enabling them to adjust the camera angle for optimal FPP recording of the examinee's facial expressions, body movements, and vocalizations. Dental interns completed pre- and post-test questionnaires to assess their perceptions of the device's impact on anxiety, communication skills, performance, distraction, technical challenges, and overall educational value. The questionnaires used a four-point Likert scale, and data were analyzed using paired sample t-tests and Mann-Whitney U tests to compare pre- and post-test scores, as well as differences between genders.

Datasets

Not discussed in the paper. The study involved 30 dental interns participating in an OSCE.

Key Insights and Ideas

  • Cost-Effective FPP Recording: Neck-mounted smartphones offer a significantly more affordable alternative to specialized wearable devices for capturing FPP video in educational settings.
  • Enhanced Communication Skill Assessment: FPP videos provide a unique perspective that can better capture non-verbal cues and the dynamics of doctor-patient interactions, leading to more comprehensive feedback on communication skills.
  • Student Acceptance and Perceived Value: Despite initial concerns about distraction, dental interns generally found the FPP video feedback valuable for self-reflection and improving their clinical performance.
  • Gender Differences in Perception: While both male and female interns showed improvements, there were some nuanced differences in their perceptions, with males reporting greater anxiety reduction and females initially expressing more concerns about negative performance impacts.
  • Bridging the Gap in Feedback: The FPP video feedback, combined with instructor feedback, offers a richer and more detailed learning experience than traditional methods alone.

Key Results

  • Reduced Anxiety and Technical Issues: Post-test results showed a significant decrease in reported anxiety about SPs wearing neck-mounted phones (70.0% reported no anxiety) and a reduction in reported technical difficulties (13.3%).
  • Improved Communication Skill Perception: A notable percentage of interns (43.3%) believed the devices enhanced communication skills.
  • Valuable Feedback: A high proportion of interns (80.0% to 93.3%) valued the feedback provided by the recordings and recognized its educational significance.
  • Willingness to Use: A substantial majority (80.0%) expressed a desire for more opportunities to use the neck-mounted phones.
  • Overall Score Improvement: The total mean score on the questionnaire significantly improved from pre-test (23.50 ± 2.81) to post-test (26.07 ± 2.97).
  • Gender-Specific Improvements: Both male and female groups showed significant improvements in their post-test scores. Notably, females showed significant improvements in perceived performance impact and willingness to use the device, while males reported a significant reduction in anxiety.

Limitations and Future Work

The authors acknowledge several limitations:

  • Smartphone Weight and Stability: Some smartphone models are heavy, leading to potential slipping or shifting, which can disrupt the camera angle.
  • Small Sample Size: The study involved only 30 participants, and the sample was restricted to interns.
  • Single-Group Design: The study used a single-group pre-test-post-test design, lacking a control group for direct comparison with traditional methods.
  • Unethical Control Group: Due to the requirement for all dental students to pass the OSCE before internship, establishing a control group for comparison with traditional methods was deemed unethical.

Future research directions suggested include:

  • Larger and Diverse Samples: Including more participants and categorizing them into interns, PGY1, and PGY2 residents for a more comprehensive analysis.
  • Investigating Gender Differences: Further in-depth studies exploring the psychological, sociocultural, and technical factors contributing to gender differences in device acceptance.
  • Exploring Other Fields: Applying this FPP video recording method to other medical and dental specialties.
  • Improving Device Stability: Developing strategies or accessories to ensure better stability of neck-mounted devices.

Summary updated

Abstract

FPP videos can be used to evaluate oral communication skills in doctor-patient interactions, enhance empathy, and contribute to holistic care.
BibTeX
@article{liu2025evaluating,
  author = {Yu‐Ching Liu and I-Ching Liao and Ching‐Yi Wu and Chung‐Han Ho and Charles Lu and K. E. P. I. N. G. Chen and Chiehfeng Chen},
  title = {{Evaluating communication and clinical skills in objective structured clinical examination (OSCE) using a low-cost neck-mounted device, insights from a first-person perspective}},
  journal = {Journal of Dental Sciences},
  year = {2025},
  doi = {10.1016/j.jds.2025.03.009},
}
Figure