Model-Predictive Control of Blood Suction for Surgical Hemostasis using Differentiable Fluid Simulations

Jingbin Huang, Fei Liu, Florian Richter, Michael C. Yip

TL;DR

This paper introduces a novel approach for automating blood suction in robotic surgery by integrating differentiable fluid simulations with model-predictive control (MPC). This allows surgical robots to learn optimal suction trajectories in real-time, significantly improving efficiency and adaptability compared to traditional methods.

What Problem Does This Paper Address?

Surgical robots are becoming increasingly sophisticated, automating tasks like suturing and tissue manipulation. However, optimizing control policies for the dynamic and unpredictable environments encountered in surgery, particularly for tasks like clearing blood to achieve hemostasis, remains a significant challenge. Existing methods often rely on data-driven approaches that struggle with variability or handcrafted policies that lack adaptability. This paper aims to bridge this gap by developing a method that can dynamically optimize suction trajectories to clear blood as quickly and efficiently as possible, even in novel or changing surgical scenarios.

Methods

The core of this work lies in the integration of three key components:

  1. Differentiable Fluid Model: The authors employ a Position-Based Fluids (PBF) simulation, which is made "differentiable." This means that not only can the simulation predict how fluids will behave, but it can also compute the gradients of fluid states (like particle positions) with respect to the suction tool's actions. This is achieved by treating all simulation operations as a computational graph and using back-propagation. This allows the system to understand how changing the suction tool's position affects the fluid dynamics.
  2. Differentiable Suction Model: A continuous and differentiable force field is designed to model the suction action. This field not only pulls nearby fluid particles towards the suction nozzle but also applies a vertical displacement, mimicking how suction clears pooling blood. This model is crucial for enabling gradients to flow from the fluid simulation to the suction tool.
  3. Model-Predictive Control (MPC): An MPC framework is used to generate optimal suction trajectories. MPC works by predicting the system's future states over a short horizon and then choosing control inputs (the suction tool's path) that minimize a defined cost function. In this case, the cost function aims to minimize the amount of remaining blood. By using the differentiable fluid and suction models, the MPC can efficiently optimize these trajectories on a per-scenario basis.

Datasets

Not discussed in the paper. The experiments were conducted using simulated environments and a real-world setup with a silicone rubber cavity.

Key Insights and Ideas

  • Differentiability is Key for Optimization: Making the fluid simulation differentiable is the critical enabler for optimizing suction trajectories. It allows the system to learn from its predictions and adapt its actions based on the fluid's behavior.
  • Real-time Adaptability: The MPC approach, combined with differentiable dynamics, allows the robot to adapt its suction strategy in real-time to the constantly changing surgical environment, a significant advantage over static or pre-programmed policies.
  • Generalization Beyond Handcrafted Policies: The proposed method demonstrates superior adaptability and generalizability across different blood emission scenarios compared to fixed, human-intuitive suction strategies.
  • Suction as a Differentiable Force Field: Modeling suction as a continuous, differentiable force field is essential for integrating it seamlessly into the differentiable fluid simulation and MPC framework.

Key Results

  • Performance: In simulated experiments, the proposed method performed as well as or better than the best handcrafted policies in clearing blood.
  • Efficiency: The method consistently achieved faster blood removal, particularly in the initial stages of suction, by avoiding situations where suction rate was slower than injection rate.
  • Adaptability: The method showed strong performance across different blood emission locations and directions, a feat that challenged handcrafted policies.
  • Real-world Validation: Experiments on a real silicone rubber cavity with a da Vinci Research Kit (dVRK) robot demonstrated the effectiveness of the approach, successfully removing over 90% of injected blood despite real-world factors like surface tension and adhesion.

Limitations and Future Work

  • Sim-to-Real Gap: While the method performed well, a thin layer of blood remained in real-world experiments due to unaccounted factors like surface tension and adhesion, which were present in the real cavity but not fully captured in the simulation.
  • Future Work: The authors plan to integrate visual feedback for initializing and correcting the fluid model in real-time using blood tracking algorithms. They also envision generalizing this framework to incorporate other physics models for automating various surgical tasks.

Summary updated

Abstract

Recent developments in surgical robotics have led to new advancements in the automation of surgical sub-tasks such as suturing, soft tissue manipulation, tissue tensioning and cutting. However, integration of dynamics to optimize these control policies for the variety of scenes encountered in surgery remains unsolved. Towards this effort, we investigate the integration of differentiable fluid dynamics to optimizing a suction tool’s trajectory to clear the surgical field from blood as fast as possible. The fully differentiable fluid dynamics is integrated with a novel suction model for effective model predictive control of the tool. The differentiability of the fluid model is crucial because we utilize the gradients of the fluid states with respect to the suction tool position to optimize the trajectory. Through a series of experiments, we demonstrate how, by incorporating fluid models, the trajectories generated by our method can perform as good as or better than handcrafted human-intuitive suction policies. We also show that our method is adaptable and can work in different cavity conditions while using a single handcrafted strategy fails.
BibTeX
@inproceedings{huang2021model,
  author = {Jingbin Huang and Fei Liu and Florian Richter and Michael C. Yip},
  title = {{Model-Predictive Control of Blood Suction for Surgical Hemostasis using Differentiable Fluid Simulations}},
  booktitle = {IEEE International Conference on Robotics and Automation},
  year = {2021},
  url = {https://openreview.net/forum?id=izNsLCmzSi},
}
Figure