An Open-Source ROS 2 Framework for Shared Control in Surgical Teleoperation: Integrating the Haply Inverse3 with the da Vinci Research Kit

Balint Varga, Sebastian Fritz, Gergely Kiss, Kristof Takacs, Peter GalambosarXiv 2026 · arXiv

Teleoperation in surgery is a bit like trying to tie your shoelaces with chopsticks while wearing thick winter gloves—you can see what you're doing, but you can't feel it. This "sensory gap" forces surgeons to rely entirely on visual cues, which can lead to increased tissue damage and longer procedure times. While high-end commercial platforms are beginning to reintroduce force feedback, they remain "black boxes" that are off-limits to researchers.

A new paper titled "An Open-Source ROS 2 Framework for Shared Control in Surgical Teleoperation" aims to break down these walls. The researchers present a modern, open-source bridge between the compact Haply Inverse3 haptic device and the da Vinci Research Kit (dVRK), providing a playground for the next generation of haptic shared-control algorithms.

TL;DR

Researchers have developed an open-source, ROS 2-native framework that integrates the affordable Haply Inverse3 haptic controller with the da Vinci Research Kit. Their study shows that even simple haptic "guidance" significantly reduces errors and task time, providing a reproducible platform for open surgical robotics research.

What Problem Does This Paper Address?

In robotic surgery, "shared control" is a paradigm where the robot doesn't just follow the surgeon's lead but actively assists—for example, by providing haptic "virtual fixtures" that gently nudge the surgeon back onto a safe path.

The challenge is that the "gold standard" haptic devices used in research are often bulky and expensive. Furthermore, most existing software integrations rely on legacy middleware. There is a pressing need for a modern (ROS 2), accessible, and open-source way to connect compact haptic hardware with surgical robots so that researchers can experiment with new ways to help surgeons "feel" their way through a procedure.

Methods

The team built a complete software stack (released under the MIT license) to facilitate this integration. Key components include:

  • ROS 2 Driver: A native interface for the Haply Inverse3 and its VerseGrip stylus, which handles high-frequency telemetry over WebSockets.
  • 6-DOF Mapping: Since the Inverse3 only tracks 3-DOF translation, the researchers combined it with the separately tracked VerseGrip orientation to create a full 6-DOF command pipeline for the da Vinci's patient-side manipulators (PSM).
  • Haptic Guidance Modes: They implemented two types of "virtual fixtures" (see Figure 2):
  • Mode 1 (Linear): A "spring-like" force that increases linearly as the surgeon deviates from the desired path.
  • Mode 2 (Progressive): A piecewise-linear profile that stays "soft" near the path to preserve dexterity but ramps up stiffness quickly as the surgeon nears a boundary.
Fig. 1: Overall system architecture of the proposed haptic shared-control framework. The Haply Driver reads the state of the Haply interface and transmits it to the Haply–DaVinci Bridge, where mapping and shared-control logic are applied. The resulting goal pose is sent to the dVRK/PSM1, and the measured robot state is fed back to the bridge and the visualization layer. RViz renders the marker-based visualization of the hot-wire task environment. Bold blocks represent the software modules developed in this work.

Datasets and Benchmarks

The framework was evaluated using a "hot-wire" benchmark task. Much like the classic "Operation" board game, users had to move a ring along a multi-segment wire without making contact.

  • Simulation: A within-subjects study with 20 participants was conducted in a simulated RViz environment.
  • Physical Hardware: The system was also validated on actual dVRK hardware to prove real-world feasibility.

Key Insights and Ideas

  • Simplicity is Robust: Surprisingly, the simpler Linear Guidance (M1) outperformed the more complex Progressive Stiffness (M2). The authors suggest that for novice operators, the sudden change in force in M2 might increase cognitive load rather than help.
  • The "Sensory Gap" is Real: Participants using haptic guidance reported feeling more in control and more satisfied with their performance, even when the visual feedback was limited to a 2D monitor.
  • Openness as a Contribution: By using ROS 2 and releasing the code, the authors have lowered the barrier to entry for other labs to study human-robot interaction in surgery without needing proprietary (and expensive) hardware-software bundles.
Fig. 2: Force feedback characteristics for the two haptic modes.

Key Results

The user study yielded clear quantitative benefits for haptic assistance:

  • Fewer Errors: Linear guidance (M1) reduced the number of wire contacts from an average of 31.85 (manual control) down to 20.90.
  • Faster Completion: Task time dropped significantly from 96.31 seconds to 75.01 seconds with linear guidance.
  • Technical Feasibility: The physical integration achieved a stable 1 kHz control loop, matching the dVRK's native rate and ensuring smooth teleoperation.
Fig. 3: Box plots showing the significant reduction in contacts (left) and completion time (right) when using Linear FF (M1) compared to No FF (M0).

Limitations and Future Work

While promising, the authors note a few caveats:

  • 2D vs. 3D: The study used a 2D monitor. In real surgery, surgeons use 3D binocular displays, which might reduce the relative importance of haptic cues.
  • Novice Users: The participants were not trained surgeons. Expert surgeons might react differently to haptic "nudges."
  • Task Complexity: The hot-wire task is a "primitive" teleoperation benchmark. Future work will involve more complex, surgically representative tasks like suturing or tissue dissection.

The team plans to integrate stereoscopic VR and explore adaptive shared control, where the robot adjusts its level of assistance based on the user's current cognitive load or skill level.

Check out the code: The framework is available on GitHub at ABC-iRobotics/haply_ros2_interface.

Summary updated

Abstract

Surgical teleoperation deprives surgeons of touch, forcing visual inference of tissue forces; the commercial platforms now restoring force feedback remain closed, preventing open research on haptic shared control. This paper provides a system contribution: it presents an open-source, ROS 2-native framework that integrates the compact, three-degree-of-freedom (3-DOF) Haply Inverse3 haptic device with the da~Vinci Research Kit (dVRK). The framework includes a novel mapping strategy that combines 3-DOF translational device input with separately tracked VerseGrip orientation into 6-DOF patient-side manipulator commands. Two virtual-fixture-inspired guidance modes serve as reference implementations to evaluate the framework in a within-subjects user study on a teleoperated hot-wire benchmark task in simulation, and the architecture is further demonstrated on physical dVRK hardware. Relative to unassisted manual control, linear guidance significantly reduced both the number of wire contacts and the task completion time, whereas the progressive-stiffness guidance produced consistent but statistically non-significant trends in the same direction. Subjective ratings of workload, agency, and satisfaction showed favorable descriptive trends for the guidance modes. The results demonstrate the feasibility of haptic shared control with a compact device coupled to the dVRK and provide an openly available, reproducible platform for future research. They further suggest that simpler linear feedback may be more robust for inexperienced operators than more complex profiles.
BibTeX
@misc{varga2026open,
  author = {Balint Varga and Sebastian Fritz and Gergely Kiss and Kristof Takacs and Peter Galambos},
  title = {{An Open-Source ROS 2 Framework for Shared Control in Surgical Teleoperation: Integrating the Haply Inverse3 with the da Vinci Research Kit}},
  year = {2026},
  eprint = {2611.26485},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.26485},
}
Figure