Feedback Synthesis For Underactuated Systems Using Sequential Second-Order Needle Variations

Giorgos Mamakoukas, Malcolm A. MacIver, Todd D. Murphey

Abstract

This paper presents a nonlinear feedback control synthesis for general control-affine systems utilizing second-order needle variations. By leveraging the Mode Insertion Hessian (MIH), the proposed method explicitly exploits nonlinear controllability through Lie brackets. Simulation results across various underactuated models—including a differential drive cart and a dynamic underwater vehicle—demonstrate that this approach achieves convergence where first-order methods fail, often with significantly lower computational overhead.

Introduction

Controlling underactuated systems—where the number of control inputs is less than the degrees of freedom—remains a fundamental challenge in robotics. Standard feedback controllers often rely on first-order gradients of a cost function. However, for systems like drones or underwater vehicles, the gradient in the desired direction of motion is frequently zero. To navigate these "forbidden" directions, controllers must exploit nonlinear interactions, typically modeled via Lie brackets. While Nonlinear Model Predictive Control (NMPC) can address these issues, its computational cost often precludes real-time application.

Second-Order Needle Variations

The core innovation of this work lies in the use of needle variations: infinitesimal, high-amplitude bursts of control applied over a short duration $\lambda$. While previous research utilized first-order variations (the Mode Insertion Gradient), this paper derives the Mode Insertion Hessian (MIH).

Conceptual visualization of a needle variation: a short-duration control pulse λ that perturbs the system state.

The MIH provides a second-order sensitivity measure that the authors prove contains explicit Lie bracket terms. This mathematical link bridges the gap between optimal control (cost minimization) and geometric control (reachability), ensuring that the controller can "see" paths to the goal that first-order analysis misses.

Methodology: Sequential Feedback Synthesis

The researchers developed a real-time feedback loop that iteratively refines control actions. The process involves simulating the system's nominal trajectory and co-states (sensitivities) over a short horizon, calculating an analytical second-order response, and performing a line search to determine the optimal duration for the control "needle."

The sequential feedback synthesis process, from simulating co-states to determining optimal control duration.

This analytical approach allows for extreme efficiency. In comparative tests, the algorithm ran approximately 40 times faster than Iterative Linear Quadratic Gaussian (iLQG) controllers.

Simulation Results and Discussion

The method was validated on three distinct models:

  1. 2D Kinematic Differential Drive: Achieved a 100% success rate in 1,000 Monte Carlo trials, whereas first-order methods often failed to orient the vehicle toward the goal.
  2. 3D Kinematic Rigid Body: Successfully navigated orientations where first-order methods encountered singularities.
  3. 3D Dynamic Underwater Vehicle: Demonstrated convergence in a high-fidelity 13-state model, successfully executing heave and roll maneuvers to reach targets unreachable by first-order logic.

Conclusion

By moving beyond simple gradients to second-order needle variations, this feedback synthesis method provides a provable descent guarantee for nonlinearly controllable systems. Future work will focus on smoothing the control pulses for hardware implementation and extending the framework to handle highly non-convex cost landscapes in complex environments.

Summary updated

Abstract

This paper derives nonlinear feedback control synthesis for general control affine systems using second-order actions---the second-order needle variations of optimal control---as the basis for choosing each control response to the current state. A second result of the paper is that the method provably exploits the nonlinear controllability of a system by virtue of an explicit dependence of the second-order needle variation on the Lie bracket between vector fields. As a result, each control decision necessarily decreases the objective when the system is nonlinearly controllable using first-order Lie brackets. Simulation results using a differential drive cart, an underactuated kinematic vehicle in three dimensions, and an underactuated dynamic model of an underwater vehicle demonstrate that the method finds control solutions when the first-order analysis is singular. Lastly, the underactuated dynamic underwater vehicle model demonstrates convergence even in the presence of a velocity field.
BibTeX
@article{mamakoukas2018feedback,
  author = {Giorgos Mamakoukas and Malcolm A. MacIver and Todd D. Murphey},
  title = {{Feedback Synthesis For Underactuated Systems Using Sequential Second-Order Needle Variations}},
  journal = {The International Journal of Robotics Research},
  year = {2018},
  doi = {10.1177/0278364918776083},
}
Figure