VTire: A Bimodal Visuotactile Tire with High-Resolution Sensing Capability

Shoujie Li, Jianle Xu, Tong Wu, Yang Yang, Yanbo Chen, Xueqian Wang, Wenbo Ding, Xiaoping Zhang

Introduction

For wheeled robots and autonomous vehicles, the tire represents the primary interface with the environment. Ideally, a tire should function as a sophisticated sensor, providing real-time feedback on terrain conditions, structural floor integrity, and its own health (e.g., punctures or wear). However, existing "smart tire" technologies often rely on point sensors like accelerometers or strain gauges, which offer low-resolution data and are susceptible to mechanical failure over time. Optical approaches have been hindered by the opaque nature of standard tire casings.

VTire concept showing bimodal data acquisition and potential application scenarios.

VTire addresses these challenges by introducing a "visuotactile" sensing paradigm. By utilizing a transparent, elastic tire structure combined with an internal imaging system, VTire captures high-resolution visual and tactile data simultaneously, enabling superior terrain recognition and damage detection.

Hardware Architecture and Sensing Mechanism

The VTire design treats the wheel as both a structural component and a high-resolution sensing lens. The architecture is comprised of three primary layers:

  1. Transparent Elastic Hub: Constructed from high-hardness Polyurethane (PU), this layer provides the necessary structural support for load-bearing while maintaining optical clarity.
  2. Sensing Skin: This dual-layer skin features a transparent silicone layer and a reflective layer (Eco-Flex 30 mixed with silver powder). The reflective layer allows the internal camera to capture surface deformations (tactile data), while the transparent regions facilitate environmental imaging (visual data).
  3. Stationary Imaging System: To avoid the complexities of rotating electronics, an Intel RealSense D405 binocular camera is mounted on a fixed internal bracket. The tire rotates around this stationary sensor, ensuring mechanical durability and stable data transmission.
Detailed hardware architecture of the VTire-equipped robot and the internal tire sensing mechanism.

Multimodal Fusion: The MMVTT Algorithm

To effectively process the dual-stream data, the researchers developed the MultiModal VisoTactile Transformer (MMVTT). This architecture uses ResNet18 backbones for feature extraction from both tactile and visual inputs. A Transformer-based fusion mechanism, employing self-attention and cross-attention, dynamically weighs the importance of each modality. For instance, in low-visibility conditions like smoke or darkness, the system automatically prioritizes tactile information over visual data.

Experimental Results

The VTire system was evaluated on a custom mobile platform across various terrains and environmental conditions. Key findings include:

  • Terrain Classification: The multimodal approach achieved a 99.2% accuracy rate across 12 different terrains, significantly outperforming single-modality methods in challenging environments.
  • Damage and Object Detection: The system identified tire punctures and cracks with 97% accuracy and successfully located small objects (e.g., screws) on the ground with a 98% success rate.
  • Load Estimation: Through Finite Element Analysis (FEA), the tire estimated vehicle loads up to 35 kg with an accuracy of 0.75 kg.
  • Durability: A 200 km continuous test at 10 km/h demonstrated no significant degradation in sensing performance, confirming the robustness of the mechanical decoupling design.

Conclusion and Future Work

VTire represents a significant advancement in robotic perception, turning the tire into a high-resolution multimodal sensor. While currently optimized for low-speed applications like delivery robots or planetary rovers due to camera frame rate constraints, future iterations will focus on high-speed optimization and integration into high-level navigation stacks. The ability to "feel" the road with high precision opens new possibilities for autonomous safety and environmental interaction.

Summary updated

Abstract

Developing smart tires with high sensing capability is significant for improving the moving stability and environmental adaptability of wheeled robots and vehicles. However, due to the classical manufacturing design, it is always challenging for tires to infer external information precisely. To this end, this paper introduces a bimodal sensing tire, which can simultaneously capture tactile and visual data. By leveraging the emerging visuotactile techniques, the proposed smart tire can realize various functions, including terrain recognition, ground crack detection, load sensing, and tire damage detection. Besides, we optimize the material and structure of the tire to ensure its outstanding elasticity, toughness, hardness, and transparency. In terms of algorithms, a transformer-based multimodal classification algorithm, a load detection method based on finite element analysis, and a contact segmentation algorithm have been developed. Furthermore, we construct an intelligent mobile platform to validate the system's effectiveness and develop visual and tactile datasets in complex terrains. The experimental results show that our multimodal terrain sensing algorithm can achieve a classification accuracy of 99.2\%, a tire damage detection accuracy of 97\%, a 98\% success rate in object search, and the ability to withstand tire loading weights exceeding 35 kg. In addition, we open-source our algorithms, hardware, and datasets at https://sites.google.com/view/vtire.
BibTeX
@inproceedings{li2025vtire,
  author = {Shoujie Li and Jianle Xu and Tong Wu and Yang Yang and Yanbo Chen and Xueqian Wang and Wenbo Ding and Xiaoping Zhang},
  title = {{VTire: A Bimodal Visuotactile Tire with High-Resolution Sensing Capability}},
  booktitle = {IEEE/ASME},
  year = {2025},
  doi = {10.1109/tmech.2025.3566394},
}
Figure