Model-Based Disturbance Estimation for a Fiber-Reinforced Soft Manipulator using Orientation Sensing

Barnabas Gavin Cangan, Stefan Escaida Navarro, Bai Yang, Yu Zhang, Christian Duriez, Robert K. Katzschmann

TL;DR

Researchers have developed a high-fidelity, Finite Element Method (FEM)-based approach to estimate external forces (disturbances) acting on a soft robotic arm using only orientation sensors. By combining the SOFA simulation framework with a quadratic programming inverse dynamics solver, they achieved a remarkably low force estimation error of approximately 1.2%, enabling applications like "teach-in" programming for compliant robots.

What Problem Does This Paper Address?

Soft robots are inherently safer for human interaction due to their compliant bodies, but this same flexibility makes them a nightmare to model and control. To perform precise tasks or interact safely with their environment, these robots need to "know" their own state and detect when something is pushing against them (disturbance estimation).

Most current approaches rely on simplified models, such as Piece-wise Constant Curvature (PCC) or matched rigid-body approximations. While computationally fast, these models fail to capture the complex, non-linear deformations of soft materials, especially when reinforced with fibers or subjected to external pressures. Data-driven methods exist but often struggle with "generalization"—they work well for the specific data they were trained on but fail when the robot's environment or configuration changes slightly.

Methods

The authors propose a model-based approach using the Finite Element Method (FEM) within the SOFA (Simulation Open Framework Architecture) environment.

  1. Detailed FEM Modeling: They built a digital twin of a multi-segment soft arm (the SoPrA). Crucially, they modeled the fiber reinforcement—which prevents the pneumatic chambers from bulging—as a series of stiff springs mapped to the FEM mesh.
  2. Orientation-Based State Observer: Instead of needing to track every point on the robot, the system uses orientation data (from markers, IMUs, or bend sensors) at specific rigid sections of the arm.
  3. Inverse Dynamics via Quadratic Programming (QP): To estimate forces, the team formulated an inverse problem. The solver looks for the external force components that best explain the difference between the robot's predicted pose and its actual sensed orientation.
  4. Two-Stage Calibration: Because manual fabrication of soft robots is imperfect, they used a calibration process to tune the material properties (Young’s Modulus) and pressure scaling factors to match the physical hardware.

Datasets

The study did not use a standard public dataset. Instead, the researchers conducted physical experiments using:

  • The SoPrA Arm: A custom 2-segment soft robotic arm with six internal pneumatic chambers.
  • Motion Capture: A Qualisys system used reflective markers to provide ground-truth orientation and pose data.
  • Force Sensing: A 1-axis force gauge used to validate the accuracy of the disturbance estimation.

Key Insights and Ideas

  • Fibers Matter: Modeling fiber reinforcement as discrete spring elements is a computationally efficient way to capture the anisotropic behavior of pneumatic actuators without needing a prohibitively complex mesh.
  • Orientation is Sufficient: You don't need a full "skin" of sensors to estimate tip forces. If the underlying FEM model is accurate, sparse orientation data from the joints/segments provides enough information to solve the inverse dynamics.
  • The Calibration Necessity: The paper highlights that "datasheet" material values are rarely sufficient for soft robotics. Empirical calibration is required to account for the "manual nature of the fabrication process."
  • "Teach Mode" Utility: By reversing the estimation logic, the authors demonstrated a "teach-in" mode where a human moves the robot by hand, and the simulation calculates the exact pressures needed to maintain that pose.

Key Results

  • Force Estimation Accuracy: The system achieved an average force estimation error of 1.2%.
  • Disturbance Estimation: In unpressurized tests, the mean force error was a tiny 0.007 N. In pressurized tests (which are more complex due to internal stresses), the mean error remained low at 0.0238 N.
  • Teach Mode Performance: When mimicking a user-defined pose, the arm showed a mean position error of only 5.2 mm and an orientation error of 4.04°.
  • Real-time Potential: The FEM simulation ran at approximately 12 Hz, which is approaching the speeds necessary for real-time closed-loop control.

Limitations and Future Work

  • External Sensing Dependency: Currently, the system relies on an external motion-capture system for orientation. The authors plan to integrate embedded IMUs to make the robot truly proprioceptive (self-sensing).
  • Contact Localization: The current model assumes the force is applied at the tip. It cannot yet automatically detect where along the arm a collision has occurred. The authors suggest adding a "sensor skin" in future iterations to solve this.
  • Scaling: While 12 Hz is good, more complex tasks or higher-degree-of-freedom robots might require further optimization of the FEM solver to maintain real-time performance.

Summary updated

Abstract

To aid in real-world situations, soft robots need to be able to estimate their state and external interactions based on proprioceptive sensors. Estimating disturbances allows a soft robot to perform desirable force control. However, even in the case of rigid manipulators, force estimation at the end-effector is seen as a non-trivial problem. And indeed, current approaches to address this challenge have shortcomings that prevent their general application. They are often based on simplified soft dynamic models, such as the ones relying on a piece-wise constant curvature approximation or matched rigid-body models that do not represent enough details of the problem. This severely limits applications in complex human-robot interaction. Finite element method (FEM) based modeling allows for predictions of soft robot dynamics in a more generic fashion. Here, using the soft robot modeling capabilities of the frame-work SOFA, we built a detailed FEM model of a multi-segment soft continuum robotic arm composed of compliant deformable materials and fiber-reinforced pressurized actuation chambers. In addition, a model for sensors that provide orientation output is presented. This model is used to establish a state observer for the manipulator. The sensor model is adequate for representing the output of flexible bend sensors as well as orientations provided by IMUs or coming from tracking systems, all of which are popular choices in soft robotics. Model parameters were calibrated to match imperfections of the manual fabrication process using physical experiments. We then solve a quadratic programming inverse statics problem to compute the components of external force that explain the pose mismatch. Our experiments show an average force estimation error of around 1.2%. As the methods proposed are generic, these results are encouraging for the task of building soft robots exhibiting complex, reactive, sensor-based behavior that can be deployed in human-centered environments.
BibTeX
@inproceedings{cangan2022model,
  author = {Barnabas Gavin Cangan and Stefan Escaida Navarro and Bai Yang and Yu Zhang and Christian Duriez and Robert K. Katzschmann},
  title = {{Model-Based Disturbance Estimation for a Fiber-Reinforced Soft Manipulator using Orientation Sensing}},
  booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
  year = {2022},
  url = {https://openreview.net/forum?id=cBsO04Evzx},
}

Loading related content...

Figure