Guest Editorial An Introduction to the Special Section on Haptic Audio-Visual Environments and Games

Abdulmotaleb El-Saddik

Abstract

This guest editorial introduces a special section of the IEEE Transactions on Instrumentation and Measurement dedicated to the 2013 IEEE International Symposium on Haptic Audio-Visual Environments and Games (HAVE 2013). It highlights two peer-reviewed works that represent significant advancements in haptic teleoperation and robotic sensing, focusing on perception-based data reduction and multimodal environmental interaction.

Introduction

The field of haptic audio-visual environments (HAVE) explores the integration of touch, sight, and sound to create immersive remote or virtual experiences. HAVE 2013 brought together international researchers to address the technical hurdles of these complex systems. Out of more than 35 submissions from 13 countries, only two papers were selected for this special section after a rigorous extension and review process, highlighting the high technical bar for these specific contributions.

Overcoming Communication and Environmental Barriers

The integration of haptics into remote systems faces two major challenges that persist in the field:

  1. Bandwidth and Latency: Real-time transmission of high-fidelity tactile and visual data is incredibly resource-intensive. In teleoperation, maintaining a sense of realism requires high packet rates, which can easily saturate network bandwidth and introduce disruptive latency.
  2. Unstructured Environments: In domestic or office settings, robots often struggle because objects are not in fixed positions. Vision alone is frequently insufficient for a robot to understand the physical properties—such as stiffness or friction—of an obstacle it needs to move or avoid.

Perception-Based Model Updating

Xu et al. propose a solution to the bandwidth problem by utilizing the limitations of human haptic perception. Their system uses Time-of-Flight (ToF) cameras to generate high-resolution point clouds of objects. By estimating physical properties such as stiffness and surface friction locally at the robot (slave) side, the system only transmits updates to the operator (master) when the change is significant enough to be felt. This "perception-based" approach results in a substantial reduction in the communication packet rate while maintaining a high-quality user experience over standard networks.

Multimodal Sensing for Unstructured Navigation

Alt and Steinbach address the challenge of robotic navigation in complex environments through visuo-haptic integration. They developed a mobile platform featuring a novel, low-cost visuo-haptic sensor. By combining visual scene analysis with tactile feedback, the robot builds a more robust "scene knowledge" than vision could provide alone. This allows the robot to "feel" its way through uncertainty, providing a layer of data that cameras cannot capture, such as the difference between a heavy solid box and a light empty one.

Conclusion

The works featured in this special section demonstrate that the future of haptic systems lies in smarter data management and multimodal sensing. By leveraging human perception thresholds and integrating touch with vision, researchers are making remote teleoperation more efficient and robotic navigation more robust in real-world, unstructured settings. These advancements pave the way for more complex applications, ranging from household assistance to advanced hapto-surgical systems.

Summary updated

Abstract

The two articles in this special section were presented at the 2013 IEEE International Symposium on Haptic Audio-Visual Environments and Games (HAVE 2013)that took place in Istanbul, Turkey, from October 26th to 27th, 2013.
BibTeX
@article{elsaddik2014guest,
  author = {Abdulmotaleb El-Saddik},
  title = {{Guest Editorial An Introduction to the Special Section on Haptic Audio-Visual Environments and Games}},
  journal = {IEEE Trans. Instrumentation \& Measurement},
  year = {2014},
  doi = {10.1109/tim.2014.2356113},
}
Figure