Structured Prediction for CRiSP Inverse Kinematics Learning With Misspecified Robot Models

Gian Maria Marconi, Raffaello Camoriano, Lorenzo Rosasco, Carlo Ciliberto

This paper, titled "Structured Prediction for CRiSP Inverse Kinematics Learning with Misspecified Robot Models," presents a robust way to teach robots how to move their joints to reach a specific target, even when the mathematical model of the robot is slightly wrong.

TL;DR

The authors introduce CRiSP-FK, a structured prediction framework that solves the Inverse Kinematics (IK) problem by combining data-driven learning with a (potentially inaccurate) forward kinematics model. By measuring errors in Cartesian "workspace" coordinates rather than joint angles, the method achieves high precision and handles physical robot constraints more effectively than traditional neural networks or purely model-based solvers.

What Problem Does This Paper Address?

In robotics, Inverse Kinematics (IK) is the task of calculating the joint angles (e.g., shoulder, elbow, wrist) needed to place the robot's "hand" (end-effector) at a specific point in space. This is notoriously difficult for two reasons:

  1. Redundancy: A robot with many joints (like a human arm) can reach the same point in infinite ways.
  2. Model Mismatch: Traditional solvers rely on a perfect mathematical model of the robot. In the real world, links might be slightly longer than the blueprint, or joints might have slight offsets. Even a tiny error in the model can lead to the robot missing its target entirely.

Purely data-driven methods (like standard neural networks) often struggle with the non-linear nature of these movements and frequently ignore physical joint limits, producing "solutions" that would actually break the robot.

Methods

The authors utilize a framework called CRiSP (Consistent Regularized Structured Predictor). Unlike standard regression, which tries to map an input directly to an output, structured prediction looks for the output that best satisfies a specific "quality" function.

The "secret sauce" here is the Forward Kinematics (FK) Loss. Instead of training the model to minimize the difference between predicted and actual joint angles (which can be misleading due to redundancy), they use the robot's own (possibly biased) forward kinematics function to see where the predicted joints would actually place the hand in 3D space.

The algorithm works in two phases:

  • Training: It builds a kernel-based model from a dataset of joint-pose pairs. This phase essentially learns how to weight previous examples to solve a new problem.
  • Prediction: For a new target pose, it solves a small optimization problem (using the L-BFGS-B algorithm) to find the joint configuration that minimizes the FK loss while staying within "box constraints" (the physical limits of the joints).

Datasets

The researchers evaluated their approach on two main setups:

  1. 5-DoF Planar Manipulator: A simulated 2D arm with five links.
  2. 7-DoF Franka Emika Panda: A high-fidelity simulation of a popular industrial collaborative robot.

As a byproduct of the research, the authors released a new dataset for IK learning involving these two robots, featuring various trajectories (like an "eight-shape" and a spiral) to test how well the models generalize to complex movements.

Key Insights and Ideas

  • Workspace > Joint Space: The most significant "aha moment" is that measuring error in the Cartesian workspace is far more robust than measuring it in joint space. Two very different joint configurations can result in nearly identical hand positions; a joint-space loss would penalize this, while a workspace loss recognizes both as valid.
  • Embracing the "Wrong" Model: The paper shows that having a "misspecified" (slightly incorrect) model is actually a huge advantage. The data-driven part of the algorithm learns to "correct" the model's bias, resulting in a system that is more accurate than the model alone and more physically grounded than a pure neural network.
  • Implicit Constraint Handling: Because the prediction step is framed as a constrained optimization, the robot never tries to rotate a joint past its physical stop—a common failure mode for standard regression models.

Key Results

The authors compared CRiSP-FK against standard Neural Networks (NN), One-Class Structured SVMs (OCSSVM), and a standard numerical solver (SDLS).

  • Accuracy under Bias: When a 3-degree bias was introduced to the robot's joints, the standard numerical solver's error exploded to 83.7 mm. In contrast, CRiSP-FK maintained a much lower error of 21.2 mm.
  • Trajectory Tracking: In the "eight-shape" trajectory test, CRiSP-FK was the only method able to track the path accurately. Other data-driven methods showed significant positional drift or failed to find smooth solutions.
  • Orientation: Unlike many previous works that only look at where the hand is, this method successfully manages both the position and the orientation (the "tilt") of the end-effector.

Limitations and Future Work

The primary drawback is computational speed.

  • Inference Time: While a standard numerical solver takes about $10^{-4}$ seconds, CRiSP-FK takes about 0.7 seconds per prediction. This is currently too slow for high-frequency, real-time control (which usually requires 1ms response times).
  • Training Scale: The training time (approx. 5 minutes for 25,000 points) is reasonable, but the memory requirements for kernel methods grow with the size of the dataset.

The authors suggest that future work will focus on "acceleration strategies" like Nyström approximation or active learning to select fewer, more "informative" data points, potentially bringing the method closer to real-time performance.

Summary updated

Abstract

With the recent advances in machine learning, problems that traditionally would require accurate modeling to be solved analytically can now be successfully approached with data-driven strategies. Among these, computing the inverse kinematics of a redundant robot arm poses a significant challenge due to the non-linear structure of the robot, the hard joint constraints and the non-invertible kinematics map. Moreover, most learning algorithms consider a completely data-driven approach, while often useful information on the structure of the robot is available and should be positively exploited. In this work, we present a simple, yet effective, approach for learning the inverse kinematics. We introduce a structured prediction algorithm that combines a data-driven strategy with the model provided by a forward kinematics function – even when this function is misspecified – to accurately solve the problem. The proposed approach ensures that predicted joint configurations are well within the robot's constraints. We also provide statistical guarantees on the generalization properties of our estimator as well as an empirical evaluation of its performance on trajectory reconstruction tasks.
BibTeX
@article{marconi2021structured,
  author = {Gian Maria Marconi and Raffaello Camoriano and Lorenzo Rosasco and Carlo Ciliberto},
  title = {{Structured Prediction for CRiSP Inverse Kinematics Learning With Misspecified Robot Models}},
  journal = {IEEE Robotics Autom. Lett.},
  year = {2021},
  url = {https://openreview.net/forum?id=UlyXDajtDhx},
}

Loading related content...

Figure