A Multimodal Haptic Interface for Simultaneous Softness and Thermal Modulation

Joshua Brown, Fernando Bello, Lynette JonesarXiv 2026 · DOI · arXiv

TL;DR

Researchers have developed a multimodal haptic interface that simultaneously modulates both softness and temperature, two critical cues for realistic touch. By integrating a "pump-free" particle jamming system with a fluidic thermal skin, the device can simulate a wide range of physical properties—from soft, cold tissue to hard, warm surfaces—with high precision and surface uniformity.

What Problem Does This Paper Address?

When we touch an object, our brain processes a symphony of sensations: texture, compliance (softness), and thermal conductivity. While the haptics industry has made great strides in simulating these cues individually, combining them into a single, cohesive interface remains a significant engineering challenge.

Most "softness-changing" displays use pneumatic systems that are bulky and difficult to integrate with thermal elements. Conversely, thermal displays often use rigid components (like Peltier modules) that interfere with the perceived softness of a surface. This paper tackles the "multimodal gap" by designing a system where the mechanical and thermal components work in harmony without compromising each other's performance. This is particularly vital for medical simulations—such as palpating a tumor or detecting vascular disease—where both the "feel" and the "heat" of the tissue provide essential diagnostic information.

Methods

The authors developed a prototype that combines two distinct technologies:

  1. Constrictive Particle Jamming: To vary stiffness, the device uses a pouch filled with quinoa seeds. Unlike traditional vacuum-based jamming, this system uses a 400W brushless DC motor to twist the fabric pouch. This "constrictive" approach exerts radial forces on the seeds, causing them to "jam" together and transition from a fluid-like soft state to a solid-like rigid state.
  2. Fluidic Thermal Skin: A thin silicone skin sits atop the jamming pouch. It contains micro-channels through which heated or cooled water is pumped.
  3. The Innovation: To ensure the skin didn't act as a thermal insulator, the authors used a copper-silicone composite (60:40 ratio by mass) for the touch surface. This maintains flexibility while significantly boosting thermal conductivity.
  4. Control: The system uses a hybrid control loop. It employs "bang-bang" control for large temperature swings and switches to a PID (Proportional-Integral-Derivative) loop for fine-tuning, achieving high stability.
Fig. 1. Schematic view of the mechanical and hydraulic components of the combined softness and temperature changing tactile display. Insert: The underside of the cast silicone skin with fluid channels visible.

Datasets

Not discussed in the paper. The study focuses on hardware design and empirical characterization rather than machine learning or large-scale data processing.

Key Insights and Ideas

  • Material Synergy: The use of a copper-powder composite is a standout "aha" moment. It solves the classic trade-off in haptics: how to make a surface that is thermally conductive enough to feel "real" but soft enough to allow the underlying jamming mechanism to be felt.
  • Thermal Isolation: The design includes a layer of pure silicone beneath the water channels. This acts as an insulator, preventing the "thermal mass" of the quinoa seeds from sucking away the heat, thereby concentrating the temperature change exactly where the user's finger makes contact.
  • Geometry Matters: The researchers moved from a rectangular to a circular frame. This simple change significantly improved the uniformity of the jamming effect, eliminating "hard spots" in the center that plagued previous designs.

Key Results

The prototype underwent rigorous mechanical and thermal testing:

  • Stiffness Range: The device achieved a 300% increase in stiffness, moving from 0.63 N/mm in its unjammed state to 2.38 N/mm at maximum torque.
  • Hysteresis: In very soft states, the elasticity of the skin caused high hysteresis (84%), but this dropped to a negligible 2.1% as the device stiffened, suggesting much higher precision during "hard" interactions.
  • Thermal Performance: The interface reached temperatures from 9.3°C to 50.2°C.
  • Precision: Once a target temperature was reached, the closed-loop system maintained it with a tiny error margin of just ±0.2°C.
Fig. 3. Stiffness and hysteresis of the display under different motor torques. Error bars represent the highest and lowest values observed across repeated measurements.

Limitations and Future Work

The primary bottleneck identified is latency. While the device is highly accurate, it is slow; it takes about 12 minutes to drop from 33°C to 15°C, and there is a 30-second delay between a command and the initial thermal response. This makes it suitable for static simulations (like a medical exam) but less ideal for fast-paced VR interactions where a user might touch multiple objects in quick succession.

Future work will focus on:

  • Reducing Size: Smaller display areas could respond much faster to thermal commands.
  • Dual Reservoirs: Implementing dedicated hot and cold water supplies to allow for near-instantaneous temperature switching.
  • Perceptual Studies: Investigating "Weber’s Illusion"—the psychological phenomenon where cold objects are perceived as heavier or harder than warm ones—using this new multimodal capability.

Summary updated

Abstract

Haptic interactions, such as touching an object in virtual reality, involve detecting a plethora of sensations through the skin. Whilst tactile displays exist to simulate and manipulate all of these cues individually, little progress has been made constructing devices that can control multiple cues simultaneously. This paper presents a tactile display technology that offers both softness and temperature change. A prototype display, based on particle jamming and the thermal transfer of heated and cooled water, is evaluated in terms of its ability to change both stiffness and temperature. Mechanical evaluations demonstrate controllable stiffness increase of 300%, whilst thermal characterisation showed strong surface uniformity and a range of achievable temperatures from 10°C up to 50°C, with closed-loop control maintaining a 0.2°C error from a setpoint. This work advances the design of multimodal tactile displays with applications to perceptual research, medical simulation, and affective haptics.
BibTeX
@misc{brown2026multimodal,
  author = {Joshua Brown and Fernando Bello and Lynette Jones},
  title = {{A Multimodal Haptic Interface for Simultaneous Softness and Thermal Modulation}},
  year = {2026},
  eprint = {2611.08398},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.08398},
}
Figure