Abstract: In recent years, Virtual Reality (VR) Head-Mounted Displays (HMD) have been used to provide an immersive, first-person view in real-time for the remote-control of Unmanned Ground Vehicles (UGV). One critical issue is that it is challenging to perceive the distance of obstacles surrounding the vehicle from 2D views in the HMD, which deteriorates the control of UGV. Conventional distance indicators used in HMD take up screen space which leads clutter on the display and can further reduce situation awareness of the physical environment. To address the issue, in this paper we propose off-screen in-device feedback using vibro-tactile and/or light-visual cues to provide real-time distance information for the remote control of UGV. Results from a study show a significantly better performance with either feedback type, reduced workload and improved usability in a driving task that requires continuous perception of the distance between the UGV and its environmental objects or obstacles. Our findings show a solid case for in-device vibro-tactile and/or light-visual feedback to support remote operation of UGVs that highly relies on distance perception of objects.
Introduction
Teleoperating an Unmanned Ground Vehicle (UGV) through a Head-Mounted Display (HMD) often suffers from a "2D bottleneck." Despite high-quality video feeds, operators struggle to judge the exact distance between the robot and its surroundings due to limited depth cues and narrow fields of view. While designers typically address this by adding digital overlays—such as proximity bars or warning text—directly onto the screen, this visual clutter can decrease situational awareness and increase cognitive load. This research investigates how to improve distance perception by moving proximity information off the primary display and into the operator's peripheral vision and tactile senses.
Methodology
The research team developed a custom teleoperation system using a DJI RoboMaster S1 as the UGV and an HTC Vive Pro Eye as the HMD. The robot was equipped with three ultrasonic sensors to measure proximity to obstacles. The core innovation lies in two "In-Device Feedback" mechanisms:
- Vibro-tactile Feedback: Small vibration motors were placed inside the HMD, contacting the user's forehead and occipital regions. The intensity of the vibration increased as the robot approached an obstacle.
- Light-visual Feedback: LED strips were installed on the periphery of the internal lenses. The number of lit LEDs in the user's peripheral vision indicated proximity, avoiding any obstruction of the main video feed.
A within-subjects study with 16 participants compared four conditions: No feedback (Baseline), Light-only, Vibration-only, and a Combined mode. Participants performed six navigation tasks designed to simulate real-world maneuvers, such as narrow passages (NSP), S-turns (STT), and precision parking (FP).
Key Results and Analysis
The study demonstrated that both light and tactile feedback significantly reduced collisions across nearly all tasks, particularly in narrow passages and tight turns. Interestingly, while feedback reduced collisions, it often increased task completion times. This suggests that when provided with better distance data, operators drive more cautiously and deliberately rather than rushing and crashing.
Subjective metrics further supported these findings. Light-visual feedback significantly reduced mental and physical workload across five out of six NASA-TLX categories. While participants found light-visual feedback more comfortable, vibro-tactile feedback was rated as more "motivating." Notably, the combined feedback mode did not significantly outperform individual modes, suggesting that a single well-implemented secondary channel may be sufficient to reach peak performance.
Discussion and Future Work
The findings confirm that the human brain can effectively process "secondary channel" information, allowing operators to maintain focus on the central driving task while subconsciously monitoring peripheral cues. However, hardware challenges remain. Future iterations will need to address the auditory interference from vibration motors and implement adaptive LED brightness to prevent distraction in different lighting conditions. The researchers aim to explore non-contact haptics, such as air-vortex or ultrasound, to further enhance the telepresence experience without the physical buzz of motors.
Summary updated