Introduction
As global populations age, healthcare systems face increasing pressure to provide efficient mobility and balance assessments. The Timed Up and Go (TUG) test is a widely used clinical tool for evaluating functional mobility. In this test, a patient is required to stand from a chair, walk 3 meters, turn 180 degrees, walk back, and sit down.
Currently, the TUG test relies on manual timing and subjective observation by clinicians, which can lead to variability and human error. Researchers from the Istituto Italiano di Tecnologia (IIT) have developed an autonomous robotic architecture for the R1 humanoid robot to standardize this assessment, providing precise kinematic data while acting as a social assistant.
Methodology
The R1 humanoid robot serves as the platform for this autonomous "test administrator." Its software architecture, built on the YARP (Yet Another Robot Platform) framework, integrates several key modules:
- 3D Skeleton Acquisition: Utilizing an Intel RealSense RGB-D camera and the
yarpOpenPoselibrary, the robot detects 2D keypoints and projects them into 3D space to track patient movement. - Reactive Navigation: To ensure the patient remains within the camera's field of view, the robot employs a "bang-bang" controller that maintains a fixed distance, moving dynamically as the patient walks.
- Motion Analysis: A specialized module calculates clinical parameters such as step length, walking speed, and specific TUG events (e.g., standing up or crossing the line).
- Speech Interaction: The robot uses Google’s Speech-to-Text and Text-to-Speech APIs to explain the test, answer questions, and provide feedback.
The system was validated through 3,000 trials in the Gazebo simulation environment, using a programmed "Actor" to simulate various walking speeds and distances.
Key Insights
A significant technical challenge addressed in this work is the accurate detection of the 3-meter finish line. The researchers found that tracking the "hip center" was insufficient due to the patient's physical volume. By implementing a bounding box around the torso, they significantly reduced false negatives. Additionally, the study reinforces the value of Socially Assistive Robots (SARs), noting that patients show higher engagement with a physical robot than with virtual agents.
Results and Performance
The simulation results demonstrated that the robotic architecture is highly reliable for clinical use:
- Timing Accuracy: The robot measured completion time with an average error of 0.47 ± 0.06 seconds.
- Step Counting: Step estimation errors ranged from 0.64 to 1.11 steps, with most errors occurring during the complex 180-degree turn phase.
- Pass/Fail Detection: The system achieved a 92.3% accuracy in determining if the patient successfully crossed the 3m line, with a 100% recall rate.
Limitations and Future Outlook
While the simulation results are promising, several challenges remain for real-world deployment. At walking speeds above 1.1 m/s, navigation lag can cause the patient to exit the camera's field of view. Furthermore, the 180-degree turn remains a difficult phase for skeleton tracking due to occlusion. Future work will involve testing the R1 platform in hospital settings with human subjects to evaluate performance against real-world variables like lighting and clothing.
Summary updated