A Comparison of Expert Ratings and Marker-Less Hand Tracking Along OSATS-Derived Motion Scales

David P. Azari, Brady L. Miller, Brian V. Le, Jacob A. Greenberg, Reginald C. Bruskewitz, Kristin L. Long, Guanhua Chen, Robert G. Radwin

Abstract

Objective: This study creates linear and generalized additive models (GAMs) of video-recorded two-dimensional hand motion (synonymously referred to as hand movements or hand kinematics) to predict expert-rated performance along a series of surgical motion scales. Background: Surgical performance assessments are costly and time consuming. Automatically quantifying hand motion may offload some burden of surgical coaching and intervention by automatically collecting features of psychomotor performance. Methods: Five experts rated anonymized video clips of benchtop suturing and tying tasks (n = 219) along four visual-analog (0-10) performance scales: fluidity of motion, motion economy, tissue handling, and hand coordination. Custom software tracked both participant hands across successive video frames and populated a robust feature set to train a series of predictive models to reproduce the expert ratings. Results: A GAM (which accounts for nonlinear effects) predicted fluidity of motion ratings with slope = 0.71, intercept = 1.98, and R <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> = 0.77 for clinicians of different experience levels. Fluidity of motion and motion economy models outperformed those created to predict hand coordination and tissue handling ratings. Conclusions: Hand motion tracking may not address all contextual features of surgical tasks. Future work will explore how well simulation-based models extrapolate to more dynamic settings of the operating room.
BibTeX
@article{azari2021comparison,
  author = {David P. Azari and Brady L. Miller and Brian V. Le and Jacob A. Greenberg and Reginald C. Bruskewitz and Kristin L. Long and Guanhua Chen and Robert G. Radwin},
  title = {{A Comparison of Expert Ratings and Marker-Less Hand Tracking Along OSATS-Derived Motion Scales}},
  journal = {IEEE Trans. Hum. Mach. Syst.},
  year = {2021},
  doi = {10.1109/thms.2020.3035763},
}

Loading related content...

Figure