Board # 39 : Identifying Affordances of Physical Manipulative Tools for the Design of Visuo-haptic Simulations

Yoselyn Walsh, Alejandra J. Magana, Tuğba Yüksel, Vojtĕch Krs, Ida Ngambeki, Edward Berger, Bedřich Beneš2018 · DOI

Abstract

This research explores the modeling and simulation of physical phenomena to improve engineering education. Specifically, it investigates how the affordances of physical manipulative tools (PMTs) influence student understanding in statics and how these insights can inform the design of more effective visuo-haptic simulations.

Introduction

Statics is a foundational subject in engineering, yet students often struggle with its abstract concepts. While physical manipulative tools (PMTs)—such as blocks and varied surfaces—are frequently employed to provide tactile feedback, they are not without flaws. Physical objects can introduce "noise," such as unexpected rotations or misleading tactile cues, which may inadvertently reinforce student misconceptions. This study aims to bridge the gap between physical tools and virtual visuo-haptic simulations by identifying which physical interactions facilitate learning and which hinder it.

Methodology and Experimental Setup

The researchers adopted a qualitative approach grounded in Gaver’s (1991) three-affordance framework to categorize student interactions with physical tools.

The three-affordance framework used to categorize student interactions based on perceptual information and actual possibilities for action.

The framework distinguishes between:

  1. Perceptible Affordances: Actions that are both possible and easily perceived.
  2. False Affordances: Actions that appear possible but do not function as expected or lead to incorrect conclusions.
  3. Hidden Affordances: Possible actions that are not immediately apparent to the user.

The Experiment

The study involved seven undergraduate students participating in four "what-if" scenarios. The setup consisted of three plastic cubes of varying weights and sizes, and three distinct surfaces: magazine paper, fabric, and foam.

Experimental setup featuring three cubes with different characteristics and three sliding surfaces (magazine paper, foam, and rough fabric).

Participants were asked to predict outcomes verbally, test their predictions using the PMTs, and then reflect on their reasoning. These "think-aloud" sessions provided the primary data for identifying misconceptions.

Key Insights: The Limitations of Physical Tools

The study revealed several critical ways in which physical tools can mislead learners:

  • False Affordances and Rotation: When students pushed a cube off-center, it often rotated. This unintended movement led many to believe friction was higher than it actually was, a clear instance of a "false affordance" reinforcing a misconception.
  • The Density Illusion: Students often struggled to separate weight from density. A smaller, denser cube was frequently perceived as heavier than a larger cube of the same weight when held in the palm.
  • Texture vs. Friction: A common misconception was equating "softness" with "smoothness." Students often assumed that foam, which feels soft, would have low friction, whereas it actually exhibited high resistance to sliding.

Design Requirements for Visuo-haptic Simulations

Based on these findings, the researchers developed a visuo-haptic simulation using the Chai3D framework and a Novint Falcon haptic device. They proposed several design requirements to mitigate the "noise" of physical tools:

  • Constrained Physics: Simulations can be programmed to apply forces only through the center of mass, preventing confusing rotations that occur in the physical world.
  • Visual Augmentation: Virtual environments allow for the display of force vectors (arrows) that change size and color in real-time, providing visual confirmation of tactile feedback.
  • Isolating Variables: To prevent the "density trap," simulations can require users to "grab" objects individually, helping them isolate weight from size more effectively than palm-weighting.

Conclusion

While the sense of touch is a powerful motivator, it is not a panacea for conceptual misunderstandings. In some cases, physical evidence was even ignored in favor of existing mental models. By identifying these "false affordances," designers can create visuo-haptic simulations that leverage the benefits of touch while providing a cleaner, more focused learning environment. Future work will involve testing these simulations with larger student cohorts to quantify their impact on conceptual mastery.

Summary updated

Abstract

modeling, procedural and inverse procedural modeling and simulation of natural phenomena.
BibTeX
@misc{walsh2018board,
  author = {Yoselyn Walsh and Alejandra J. Magana and Tuğba Yüksel and Vojtĕch Krs and Ida Ngambeki and Edward Berger and Bedřich Beneš},
  title = {{Board \# 39 : Identifying Affordances of Physical Manipulative Tools for the Design of Visuo-haptic Simulations}},
  year = {2018},
  doi = {10.18260/1-2--27845},
}
Figure