SlickFeel: sliding and clicking haptic feedback on a touchscreen

Xiaowei Dai, Jiawei Gu, Xiang Cao, J. Edward Colgate, Hong Z. TanUIST (Adjunct Volume) 2012 · DOI

TL;DR

This paper introduces SlickFeel, a novel single-hardware haptic display that simultaneously provides both sliding (texture) and clicking (key-press) feedback on touchscreens. This integrated approach aims to enhance touchscreen interaction by reducing reliance on visual cues, making mobile device usage more intuitive and less visually demanding.

What Problem Does This Paper Address?

Modern mobile devices heavily rely on touchscreens, which, despite their ubiquity, often lack rich tactile feedback. Interacting with onscreen elements like icons or typing on a virtual keyboard typically requires constant visual monitoring. When sliding a finger over an icon, there's no sensation, and button presses are usually confirmed only by visual state changes. This forces users to constantly shift their gaze between different parts of the screen, especially during tasks like thumb-typing, leading to a less efficient and more fatiguing user experience. While vibrotactile feedback exists for key presses, it's often a generic buzz that doesn't mimic the nuanced sensations of interacting with physical buttons or textured surfaces. The paper addresses the need for a more sophisticated and integrated haptic solution that can provide distinct, context-aware feedback for both continuous sliding interactions and discrete button clicks on a single touchscreen surface.

Methods

SlickFeel utilizes a single hardware setup to deliver two distinct types of haptic feedback: sliding feedback and clicking feedback.

  • Sliding Feedback (Texture): This is achieved using a technique similar to the Tactile Pattern Display (TPaD). Piezo actuators, glued to the edges of a glass plate, are activated at a high ultrasonic frequency (around 30 kHz). This causes the glass to resonate, modulating the friction between the user's finger and the glass surface. By varying the resonance, different friction levels can be created, simulating textured surfaces.
  • Clicking Feedback (Key-Press): This feedback is generated by separate piezo actuators. When a button is pressed, these piezos are activated with a short, 500 Hz raised sinusoidal signal, creating a distinct "key-click" sensation.

A key innovation is the integration of these two feedback types on a single display. The authors addressed the challenge of preventing interference between the high-frequency TPaD vibrations and the lower-frequency click signals by carefully adjusting the actuation frequencies and the size/placement of the key-click piezos. The system was integrated with a standard 7" Kindle Fire tablet, with the tablet's touchscreen sending finger position data to a PC via Wi-Fi. The PC then processes this data and sends control signals to the SlickFeel driver board, which amplifies and drives the piezo actuators. The system is designed to be mechanically isolated, allowing for simultaneous feedback to two fingers.

Datasets

Not discussed in the paper. The paper focuses on the hardware implementation and demonstration of the haptic feedback system through two specific scenarios.

Key Insights and Ideas

  • Unified Haptic Feedback: The core insight is that a single hardware setup can effectively deliver both continuous sliding (texture) and discrete clicking feedback, eliminating the need for separate actuators or complex switching mechanisms.
  • Mimicking Real-World Sensations: SlickFeel moves beyond generic vibrations to provide more nuanced tactile experiences, simulating textured surfaces and distinct key-click sensations, which are more intuitive for users.
  • Reducing Visual Load: By providing reliable tactile cues, SlickFeel allows users to interact with touchscreens without constant visual monitoring, particularly beneficial for tasks like thumb-typing, freeing up visual attention for content.
  • Leveraging Existing Mobile Hardware: The successful integration with a Kindle Fire tablet demonstrates that SlickFeel can be applied to existing mobile devices, paving the way for broader adoption.
  • Importance of Piezo Actuators: The paper highlights the advantages of piezo actuators for this application, specifically their fast response time and wide bandwidth, which are crucial for rendering both high-frequency texture modulations and distinct click sensations.

Key Results

The paper demonstrates the functionality of SlickFeel through two scenarios:

  • Button-Click Scenario: Users can feel the positions of four buttons on a touchscreen by sliding their finger. Different buttons are rendered with varying friction (rough vs. smooth) and distinct click feedback signals are provided for buttons with smaller vs. larger travel distances.
  • Thumb-Typing Scenario: In a haptically-enhanced thumb-typing interface, users can feel textured input areas and receive key-click feedback when selecting letters. This allows users to maintain thumb positions on input controls without needing to visually track them, focusing instead on the document and the letter selection ribbon.

While quantitative results like accuracy or user study metrics are not presented, the qualitative demonstration shows that SlickFeel can effectively convey distinct tactile information for both sliding and clicking interactions on a standard mobile touchscreen.

Limitations and Future Work

  • Limitations:
    • The paper does not present quantitative user study data to measure the impact of SlickFeel on task performance, efficiency, or user satisfaction.
  • The current implementation is a prototype, and further work would be needed to miniaturize and integrate it into mass-produced devices.
  • The paper doesn't detail the specific challenges or limitations in rendering a wide variety of textures or complex clicking patterns beyond the demonstrated examples.
  • Future Work:
    • The authors suggest that SlickFeel can be used with existing mobile touchscreen devices, implying potential for integration into future product designs.
  • Further research could explore a wider range of haptic textures and click sensations, as well as more complex interaction scenarios.
  • Quantitative user studies would be valuable to validate the benefits of SlickFeel in real-world applications.

Summary updated

BibTeX
@inproceedings{dai2012slickfeel,
  author = {Xiaowei Dai and Jiawei Gu and Xiang Cao and J. Edward Colgate and Hong Z. Tan},
  title = {{SlickFeel: sliding and clicking haptic feedback on a touchscreen}},
  booktitle = {UIST (Adjunct Volume)},
  year = {2012},
  doi = {10.1145/2380296.2380308},
}
Figure