A Novel Approach for Virtual Locomotion Gesture Classification: Self-Teaching Vision Transformer for a Carpet-Type Tactile Sensor

Sung-Ha Lee, Ho-Taek Joo, Insik Chung, Donghyeok Park, Yunho Choi, Kyung-Joong Kim

Abstract

Locomotion gesture classification in virtual reality (VR) is the process of analyzing and identifying specific user movements in the real world to navigate virtual environments. However, existing methods often necessitate the use of wearable sensors, which present limitations. To address this, we utilize a high-resolution carpet-type tactile sensor as a foot action recognition interface, which is previously unexplored in the context of locomotion gesture classification. This interface can capture the user’s foot pressure data in detail to distinguish similar actions. In this paper, to efficiently process captured user’s foot tactile data and classify nuanced actions, we propose a vision transformer (ViT) architecture and a novel self-teaching vision transformer (STViT) model integrating elements of the shifted window vision transformer (SwinViT) and data-efficient image transformer (DeiT).
BibTeX
@inproceedings{lee2024novel,
  author = {Sung-Ha Lee and Ho-Taek Joo and Insik Chung and Donghyeok Park and Yunho Choi and Kyung-Joong Kim},
  title = {{A Novel Approach for Virtual Locomotion Gesture Classification: Self-Teaching Vision Transformer for a Carpet-Type Tactile Sensor}},
  booktitle = {VR},
  year = {2024},
  url = {https://openreview.net/forum?id=cWvLmvjBvn},
}

Loading related content...

Figure