HapticWhirl, a Flywheel-Gimbal Handheld Haptic Controller for Exploring Multimodal Haptic Feedback

Jose Luis Berna Moya, Anke van Oosterhout, Mark T. Marshall, Diego Martínez PlasenciaSensors 2024 · DOI

TL;DR

This paper introduces HapticWhirl, a novel handheld VR controller that uses a single flywheel-gimbal system to generate multiple haptic feedback modalities. This innovative design aims to overcome the limitations of current haptic devices that typically offer only one type of feedback, thereby enriching the immersive experience in virtual environments.

What Problem Does This Paper Address?

The current landscape of haptic feedback in virtual reality (VR) is limited. While VR technology has advanced rapidly, haptic controllers have lagged behind, often offering only a single modality of stimulus (e.g., simple vibration). This restricts the expressiveness and realism of virtual interactions. To achieve more complex haptic experiences, current approaches often require integrating multiple actuators, leading to increased complexity in design, construction, and control. This paper addresses the need for a more versatile and expressive handheld haptic controller that can deliver a range of kinaesthetic feedback using a single, integrated system.

Methods

The core of the HapticWhirl controller is a flywheel, repurposed from a hard disk drive, mounted on a two-gimbal system. This allows the flywheel's orientation to be controlled in two degrees of freedom (pitch and yaw) over 360 degrees. The rotation of the gimbals is driven by Maxwell DC motors with a pulley system, and their speed and direction are managed by an H-bridge controller. A magnetic encoder provides real-time feedback on gimbal orientation and speed.

To generate diverse haptic effects, the system incorporates:

  • Gyroscopic Effect: By changing the orientation of the spinning flywheel, the controller generates torque, simulating forces like push or pull. This is governed by the principles of angular momentum.
  • Braking Mechanism: A drum brake, actuated by a microservo, allows for rapid stopping of the flywheel. This is crucial for simulating impacts and sudden jolts.
  • Dynamic Actuation: The gimbals can oscillate the flywheel rapidly to create low-frequency, high-amplitude vibrations.
  • Controlled Latency: Introducing a delay in the controller's response emulates inertia and the sensation of moving through a resistive medium.

The controller's design is open-source and open-hardware, facilitating its replication and further development.

Datasets

Not discussed in the paper. The paper focuses on the design, implementation, and experimental validation of the HapticWhirl controller itself, rather than training or evaluating on external datasets.

Key Insights and Ideas

  • Single Actuator, Multiple Modalities: The most significant insight is the successful demonstration that a single, integrated system (flywheel + gimbals + brake) can generate a surprisingly diverse range of haptic feedback, including torque, vibration, impact, inertia, and a novel "whirl" effect. This challenges the prevailing notion that complex haptics require multiple, disparate actuators.
  • Leveraging Gyroscopic Precession for "Whirl" Effect: The paper introduces a novel "Whirl Mode" that utilizes gyroscopic precession. By continuously rotating the flywheel's orientation axis, a sustained stirring or rotational force is generated, offering a unique simulation capability not easily achieved with other methods.
  • Open-Source for Innovation: The decision to make the design open-source and open-hardware is a key strategic choice, aiming to democratize access to advanced haptic technology and foster community-driven innovation.
  • Demystifying Gyroscopic Haptics: The authors explicitly aim to bridge the gap between complex gyroscopic theory and practical application, providing resources to make this technology more accessible to researchers.

Key Results

  • Torque Output: The HapticWhirl can generate a peak output force of 4.34 N, resulting in an approximate torque of 0.68 Nm at a distance of 160 mm from the anchor point. While lower than some specialized devices, this is within the perceivable range for human users.
  • Impact Simulation: The brake mechanism can stop the flywheel in under 300 ms, producing a sudden peak torque of approximately 1.8 Nm, effectively simulating impacts.
  • Vibration: The device can produce distinct low-frequency, high-amplitude vibrations, with higher magnitudes when the flywheel is also rotating.
  • Whirl Effect: Consistent torque outputs of approximately 0.2 Nm were measured across different axes when generating the whirl effect.
  • Comparison to Existing Work: The paper positions HapticWhirl's torque output as lower than some specialized devices (e.g., iTorqu, Nakamura's design) but highlights its advantage in offering multimodal feedback from a single actuator, unlike many existing devices.

Limitations and Future Work

  • Torque Output: The authors acknowledge that the peak torque output is lower than some specialized devices. This is partly attributed to the use of off-the-shelf components and a lighter flywheel compared to custom-built alternatives. Future work will focus on increasing torque capabilities through user studies and potential hardware improvements.
  • Brake Mechanism Lifespan: The strong actuations of the brake mechanism were noted to limit the device's lifespan. Future iterations will involve a redesign of the braking mechanism and a faster motor to address this.
  • Vibration Frequency Limitations: Due to motor limitations, high-frequency vibrations (above 25 Hz) with the flywheel rotating at full speed were not achievable without motor drift.
  • Structural Integrity: Future work will focus on improving the structural integrity of the device, particularly the axis of rotation, for enhanced resilience under high-speed and high-torque operations.
  • User Evaluation: A significant part of future work involves user evaluation of the device and its five operational modes in VR environments.
  • Retargeting Applications: The paper suggests exploring applications for subtle hand repositioning in VR, where torque is gradually incremented to avoid perceptible detection.

Summary updated

Abstract

Most haptic actuators available on the market today can generate only a single modality of stimuli. This ultimately limits the capacity of a kinaesthetic haptic controller to deliver more expressive feedback, requiring a haptic controller to integrate multiple actuators to generate complex haptic stimuli, with a corresponding complexity of construction and control. To address this, we designed a haptic controller to deliver several modalities of kinaesthetic haptic feedback using a single actuator: a flywheel, the orientation of which is controlled by two gimbals capable of rotating over 360 degrees, in combination with a flywheel brake. This enables the controller to generate multiple haptic feedback modalities, such as torque feedback, impact simulation, low-frequency high-amplitude vibrations, inertial effects (the sensation of momentum), and complex haptic output effects such as the experience of vortex-like forces (whirl effects). By combining these diverse haptic effects, the controller enriches the haptic dimension of VR environments. This paper presents the device's design, implementation, and characterization, and proposes potential applications for future work.
BibTeX
@inproceedings{moya2024hapticwhirl,
  author = {Jose Luis Berna Moya and Anke van Oosterhout and Mark T. Marshall and Diego Martínez Plasencia},
  title = {{HapticWhirl, a Flywheel-Gimbal Handheld Haptic Controller for Exploring Multimodal Haptic Feedback}},
  booktitle = {Sensors},
  year = {2024},
  doi = {10.3390/s24030935},
}
Figure